# Changelog On this page you will find the most recent entries to the Data Platform changelog (i.e. what has been updated on the platform). --- ## August 31, 2026 ### Lakehouse Manager - **[Views](/en/product/lakehouse-manager/views/index.md):** save a SQL `SELECT` query as a named virtual table inside a dataset and query it like a table, with results always computed live from the source tables. - Columns are derived automatically from the SQL, which is validated on every create and edit with human-readable errors. - Views track their own **Valid** or **Broken** status: they are re-checked automatically when a source table changes and recover on their own once the source is restored. - Policy tags, dataset permissions, and the audit trail apply to views just like to tables, and views created by external tools are discovered automatically. - **[Filtered tabs](/en/product/lakehouse-manager/tables/index.md?id=filtered-tabs):** filtered views in the Tables section are renamed to filtered tabs, to avoid confusion with the new views. ### Data Processing Engine - **[Deduplicate action](/en/product/dpe/actions/deduplicate/index.md):** new ready-to-use action to remove duplicate rows from a lakehouse or PostgreSQL table, keeping exactly one row per deduplication key. - The key is pre-filled from the table's identifier fields, a read-only scan previews how many rows a run would remove, and you choose which row survives (any, most recent, or oldest). - An optional backup table protects the run; on lakehouse tables a run can also be undone with Time Travel. - **Parallel job runs:** launching the same job several times in parallel is now safe: each run keeps its own data and results. - **[Spark History](/en/product/dpe/spark-history-server/index.md):** the Spark application history is now reachable from older jobs too, not only the most recent ones. - **Fixes:** - when a job fails because a secret cannot be read, the actual cause is now shown instead of an opaque error. - the Rebuild action confirmation now shows the name of the table being rebuilt. --- ## August 24, 2026 ### Lakehouse Manager - **[Lineage](/en/product/lakehouse-manager/lineage/index.md):** a new built-in lineage view maps how data flows through your project, from the pipelines that feed each table down to the tables built from it. - Open it from the new **Lineage** section or straight from a table's details page, and drill down to column-level lineage. - Lineage now covers PySpark too: automatic for Load and Aggregate PySpark actions, opt-in through the [SDK](/en/technical/sdk/dpe/3E.lineage.md) for Custom PySpark actions and PySpark notebooks. - **Fixes:** - checkboxes in the Tables list view are now correctly aligned. - sharing a dataset with a consumer project that does not exist now returns a clear error instead of a storage engine failure. ### Data Processing Engine - **[Notebook export as a custom action](/en/product/dpe/notebooks/data-platform-extension.md?id=export-a-notebook-as-a-custom-action):** the Data Platform extension can now turn a notebook into a custom action directly from JupyterLab, with the notebook's pip installs automatically converted into action dependencies. - **Fixes:** - environment variables already defined on a job are no longer overridden when the job starts. ### Control Center - **Fixes:** - job metric charts now display over any time range: the measurement precision adapts to the selected window instead of failing on wide ranges. --- ## August 3, 2026 ### General - **New guide:** [Trino data types and casts](/en/getting-further/trino-types-and-casts/index.md), covering the mapping between Lakehouse types and Trino types and how to fix `TYPE_MISMATCH` errors when writing through Trino. - **Expanded docs:** deeper Lakehouse Manager pages on data types, naming rules, the storage model, and cross-project sharing, plus new Data Processing Engine docs on code sharing between actions, triggering notebooks from workflows, and CI/CD. ### Lakehouse Manager - **Fixes:** - sharing a dataset in read-only no longer downgrades the owner's own read-write access to that dataset. - the API now returns a 404 error instead of a 500 when a resource is missing or was deleted. ### Data Processing Engine - **[Data Platform Extension](/en/product/dpe/notebooks/data-platform-extension.md):** a new JupyterLab extension adds a side panel to browse your project's datasets and storage buckets, run quick read-only SQL queries, and start from a gallery of ready-to-use notebooks wired to your own data. - **marimo extension:** the marimo notebook extension is now preinstalled in all notebook images. - Both extensions are new: try them out and share your feedback. - **[Custom action helpers](/en/product/dpe/actions/custom/index.md?id=use-the-helper-panel):** the helper panel in the Custom action and [Custom PySpark](/en/product/dpe/actions/custom-pyspark/index.md?id=use-the-helper-panel) editors now offers ready-to-use scenarios organized by category, SDK guides, a tab to browse your data, and a FAQ. ### Control Center - **[Audit trail](/en/product/cc/audit/index.md):** new event types record configuration export and import operations. - **Fixes:** - job logs in the [Logs Explorer](/en/product/cc/logs/index.md) now display in the correct order without gaps or duplicated lines, streaming resumes after an interruption, and a loading error is shown instead of an empty log view. - the **Open logs** button now opens the Logs Explorer with the correct parameters instead of doing nothing. ### Apps and API - **Application scheduling (beta):** automatically start and stop an application (apps, APIs, Superset) during weekly activity windows, to avoid paying for idle time. - Pick a timezone and add one or more windows with days and start and stop times; outside these windows the application is stopped. - Transitions are evaluated about every 5 minutes, so a start or stop can be delayed by up to 5 minutes. - **In-memory caching (beta):** deploy a Valkey or Redis cache alongside an application service. - Choose the cache engine version and the share of DPU allocated to it (10 to 50%); the change takes effect after restarting the deployed version. - **SQLite backups (beta):** applications that store data in SQLite can now enable automatic backups. - Set the daily retention in days and how many weekly and monthly backups to keep, and open stored backups directly in the Lakehouse. --- ## July 20, 2026 ### Lakehouse Manager - **[Iceberg bucket](/en/product/lakehouse-manager/buckets/index.md?id=iceberg-bucket):** the Buckets screen now lists your project's Iceberg bucket, the storage behind your Lakehouse tables, in read-only mode. ### Data Processing Engine - **[Overview](/en/product/dpe/index.md) heatmap:** job activity is now grouped by day and 4-hour slot, with run counts shown per cell and only finished jobs counted. - **Build logs:** logs from the build phase of a job are now available, so errors during a build are visible and easier to debug. - **Notebook import and export:** notebooks are now imported and exported as ZIP archives. - **[Workflows](/en/product/dpe/workflows/configuration.md):** a workflow must now contain at least one action to be started; empty workflows can no longer be run. --- ## July 6, 2026 ### General - **Configuration export and import:** each service module can now be imported directly from the UI, without calling an endpoint to import a configuration. ### Lakehouse Manager - **Fixes:** - **Explore snapshot** from Time Travel now redirects to the [Explorer](/en/product/lakehouse-manager/explorer/index.md) with the snapshot loaded. - searching a dataset by its full name (for example `default_dataset`) now returns the dataset instead of "You have no dataset". - deleting a shared dataset from a receiving project no longer leaves the Explorer without a dataset name. ### Data Processing Engine - **[Overview](/en/product/dpe/index.md) metrics:** new **Resource consumption**, **Top consumers**, and **Spark History Server** metrics, with a selectable last 7, 30, or 90 day range and faster loading. - **Fixes:** the [Rebuild action](/en/product/dpe/actions/rebuild/index.md) now mirrors an attribute's state when it is marked **Required + Identifier**. ### Control Center - **[Overview](/en/product/cc/index.md) metrics:** new **Total resource consumption**, **Data scanned over time**, **DB storage (tables)**, and **Object storage (buckets)** metrics, shown both as current values and over time. - Metrics on the Overview and [Jobs Central](/en/product/cc/job-central.md) now load faster. - **Fixes:** - the [Alerts](/en/product/cc/alerting/index.md) page now shows an error notification when alerts fail to load, instead of an empty "No alerts" state. - the [Audit trail](/en/product/cc/audit/index.md) now loads further entries when paging past the cached results, at both dataplant and organization level. --- ## June 22, 2026 ### General - **App Service component count:** the organization home now shows the number of deployed App Service components on each project box. - **New tutorial:** [Build an IoT fleet-monitoring pipeline](/en/getting-further/iot-fleet-monitoring/index.md), an end-to-end guide streaming simulated sensor data from a Custom action through Kafka into a live Superset dashboard. ### Connectors - **Database connector pagination:** the database connector list is now paginated, making large lists easier to browse. - **Fixes:** sorting by column header now works on the Trino consumers table. ### Lakehouse Manager - **[Required and Identifier fields](/en/product/lakehouse-manager/tables/table-interactions.md?id=attribute-constraints):** attributes can now be marked **Required** (never NULL) or **Required + Identifier** (part of the row's uniqueness key for upserts). - Required fields cannot be added once a table is built; use the new [Rebuild action](/en/product/dpe/actions/rebuild/index.md) to add them. Identifier fields cannot be `double` or `decimal`. - **Table metrics:** tables now have a **Metrics** section surfacing key statistics about the table. - **Fixes:** in the [Explorer](/en/product/lakehouse-manager/explorer/index.md), the **Export as CSV** button is disabled with an explanatory message when no query engine is active. ### Data Processing Engine - **[Write strategy](/en/product/dpe/actions/settings/index.md?id=write-strategy):** Load and Aggregate actions (Python and PySpark) can now upsert using a table's identifier fields. - Choose **Upsert**, **Insert when not matched**, or **Insert all** in the action preferences. - Actions default to **Insert all**; select **Upsert** manually to enable matching behavior. - **[Rebuild action](/en/product/dpe/actions/rebuild/index.md):** rebuild a table from scratch to change field constraints, restructure partitioned data, and clean its metadata. - Set a default value when promoting a field to Required/Identifier; optionally keep a backup of the previous table. - Removes all table history; Time Travel is no longer available after a rebuild. - **[SQL action](/en/product/dpe/actions/sql/index.md):** write and run a SQL query against your datasets and tables on the Trino engine, as a schedulable, workflow-ready action. - Supports reads, metadata, DML, DDL, and `CREATE TABLE AS SELECT`, which also builds the new table in the Lakehouse Manager. - Validate before creating, with destructive-query confirmation and a re-validation check on every run. - **[Spark History Server](/en/product/dpe/spark-history-server/index.md):** inspect the execution history of your PySpark actions and workflows from a new DPE page. - Start the server on demand to browse recent runs; it auto-stops when idle and is billed per DPU only while running. - Open each run's **Spark UI**, or analyze it with **DataFlint** performance insights, live or after completion. ### Analytics Manager - **Fixes:** in [Queries](/en/product/am/queries/index.md), the **Export as CSV** button is disabled with an explanatory message when no query engine is active. ### Control Center - **[Logs Explorer](/en/product/cc/logs/index.md) performance:** the Logs Explorer now issues a single metrics and jobs request instead of one per project, speeding up loading. - **[Alerting](/en/product/cc/alerting/index.md):** the **Create alert** action is available again from the project homepage. - **Fixes:** - logs no longer display "Invalid date". - refreshing the [Auditing](/en/product/cc/audit/index.md) trail no longer duplicates rows. ### Apps and API - **App Service UI (beta):** a redesigned, more unified interface for the App Service is now available as a beta, bringing it in line with the rest of the platform. - We will ship improvements and updates continuously over the coming weeks and months. Your feedback is welcome. - **Fixes:** creating an environment variable no longer fails with a 400 error. --- ## June 2, 2026 ### Connectors - **[Trino consumers](/en/product/connectors/consumers/trino/index.md):** create a Trino connection string in a few clicks from the **Consumers** tab, instead of setting up a service account, API keys, and the connection string by hand. - Pick a **READ** or **READ & WRITE** access level per consumer. - The connection string appears only once, at creation; each consumer has a dedicated service account. --- ## May 25, 2026 ### General - **Contact Support:** the **[Contact Support](/en/support/index.md)** link now opens an in-platform support form instead of redirecting to the external OVHcloud Help Centre. ### Lakehouse Manager - **[Cross-project dataset sharing](/en/product/lakehouse-manager/datasets/index.md?id=cross-project-sharing-beta) (beta):** datasets can now be shared read-only with other projects in the same organization. - Admins share from the source project via the dataset's **Configuration** tab → **Manage share settings** → pick one or more target projects. - Receiving projects see the dataset in their Lakehouse Manager **Datasets** menu with a shared icon and the type **Lakehouse Manager (shared)**. Tables can be previewed but not modified. - In the [Explorer](/en/product/lakehouse-manager/explorer/index.md), shared tables appear under a new **Shared Datasets** category in the *list by dataset* view. SQL editor only. ### Data Processing Engine - **Fixes:** importing a DPE configuration into another project now correctly rewrites repository references in workflows. Previously, workflows imported into the destination project still pointed to the source project's `repository_id` for the **Default** repository, breaking action references. ### Control Center - **[Auditing](/en/product/cc/audit/index.md):** notebooks are now covered by the audit trail. --- ## May 5, 2026 ### Connectors - **New connectors:** - [HubSpot](/en/product/connectors/sources/connectors/hubspot/index.md) — extract contacts, companies, deals, tickets, pipelines, forms, marketing emails, and more. - [Odoo](/en/product/connectors/sources/connectors/odoo/index.md) — extract contacts, CRM leads, sales orders, invoices, products, inventory, HR, and projects from your Odoo ERP instance. Compatible with Odoo 14–19. - [Salesforce](/en/product/connectors/sources/connectors/salesforce/index.md) — extract standard and custom sObjects, run SOQL and SOSL queries, list reports, and inspect org limits. - [Shopify](/en/product/connectors/sources/connectors/shopify/index.md) — extract products, customers, orders, inventory, marketing, B2B, payments, and content via the Shopify GraphQL Admin API. - [Stripe](/en/product/connectors/sources/connectors/stripe/index.md) — extract customers, charges, payment intents, subscriptions, invoices, balance transactions, and events. - Each new connector ships with a companion **Technical Reference** page covering authentication, the full endpoint catalogue, pagination, rate limits, output format, and limitations. ### Data Processing Engine - **Fixes:** - selecting resource allocation when creating an action or workflow no longer freezes the screen. - updating the environment on an existing action no longer freezes the screen. ### Control Center - **Fixes:** the [Auditing](/en/product/cc/audit/index.md) refresh icon now preserves the selected time range instead of resetting to the last 6 hours. --- ## April 20, 2026 ### General - **Maintenance banner:** a banner is now shown in the [header](/en/product/navigation/header.md?id=maintenance-banner) for the duration of any scheduled platform maintenance. While active, the platform is read-only; run operations remain allowed. ### Connectors - **OpenLineage consumer:** - auth token is now optional. - new **Disable Trino events** toggle - skip Trino-generated lineage (Explorer, Analytics Manager) and forward only DPE batch lineage. - **Fixes:** schemas no longer displayed incorrectly in Marquez for forwarded lineage events. ### Lakehouse Manager - **Explorer:** - **Export to CSV:** scale fields now come before data fields in visual-query CSV exports (download and bucket export). - all non-numeric values are now quoted in CSV exports — avoids parsing issues with commas, quotes and line breaks. - **Fixes:** **Preview table** now opens the Explorer with the selected table loaded. ### Data Processing Engine - **Git dependency auto-update:** [Custom](/en/product/dpe/actions/custom/index.md) and [Custom PySpark](/en/product/dpe/actions/custom-pyspark/index.md) actions now support `@latest` in Git-hosted Python dependencies: - Append `@latest` to any `git+` dependency URL to automatically resolve the most recent published release at build time. - Click **Force Build** to pick up a new version — no more manual tag or commit hash updates across actions. - Note: the latest release is not detected automatically at runtime — a manual **Force Build** is required to pull the update. - **Custom action lineage SDK:** new `lineage_run` context manager — auto-emits `START` / `COMPLETE` / `FAIL` and generates `run_id`. - **Custom action lineage helpers:** new `schema_facet` (declare schemas) and `column_lineage_facet` (column-to-column mappings). - **Auto schema detection:** pass `connector=` to `lineage_run` to extract schemas automatically. - Updated docs: [Track data lineage in a Custom action](/en/technical/sdk/dpe/3E.lineage.md). ### Analytics Manager - **Queries:** - **Export to CSV:** scale fields now come before data fields in visual-query CSV exports (download and bucket export). - all non-numeric values are now quoted in CSV exports — avoids parsing issues with commas, quotes and line breaks. ### Control Center - **New — [Auditing](/en/product/cc/audit/index.md) (initial release):** logs significant create / update / delete activity on the platform. Coverage will expand in upcoming releases. - Project-level view in Control Center; filter by service (Connectors, Lakehouse Manager, DPE, Analytics Manager, IAM), resource and time window. - Organization-level view in Organization Settings. Currently covers organization IAM and member management; billing, quotas and similar are coming soon. - Two new roles at each level: **Audit Trail Admin** and **Audit Trail Viewer**. - **Alerting (beta):** [alerting](/en/product/cc/alerting/index.md) has been reworked and re-enabled. Please report any issues you run into. - **Fixes:** Logs Explorer now displays execution logs for DPE actions and workflows correctly. --- ## April 7, 2026 ### Lakehouse Manager - **OpenLineage compliance:** Data Platform now tracks and exposes data lineage events using the [OpenLineage](https://openlineage.io/) standard. Lineage events are recorded automatically for Load and Aggregate actions, and opt-in for Custom actions. - **Fixes:** Query Gateway now correctly auto-infers `catalog.schema` for Direct Query catalogs. This only affected tables with Direct Query enabled. ### Connectors - **New Consumer:** Added the [OpenLineage consumer](/en/product/connectors/consumers/openlineage/index.md) — connect your own OpenLineage-compatible lineage solution (e.g. Marquez) by providing an endpoint URL and auth token. ### Data Processing Engine - **New Action:** Added [Send OpenLineage Events](/en/product/dpe/actions/send-openlineage-events/index.md) — forward data lineage events from Data Platform to your external lineage backend. Supports cron scheduling or always-up continuous mode. - **SDK:** Added documentation for [tracking data lineage in Custom actions](/en/technical/sdk/dpe/3E.lineage.md) using the `emit_lineage` function. Lineage is opt-in for Custom actions — declare inputs/outputs and emit `START`, `COMPLETE`, and `FAIL` events to integrate with the platform's OpenLineage graph. - **Fixes:** - Cron jobs are now active by default upon creation. - Execution logs for newly created actions and workflows are now displayed correctly. --- ## March 23, 2026 ### Data Processing Engine - Improved **Spark** job launch and workflow stability. - **Actions & workflows:** Added option to deactivate and reactivate **cron** jobs instead of deleting them. - **Fixes:** Environment variables field no longer overflows the layout for long values. ### Lakehouse Manager - **Attributes:** Attribute naming rules are now displayed. - **Explorer:** - Fixed export of **CSV** results to bucket for visual queries. - Fixed incorrect alert icon for direct-query sources after metadata extraction. --- ## March 9, 2026 ### Connectors - **New Connector:** Added support for the **FHIR** connector. - **Updates:** - Updated **ClickHouse** connector. - Fixed SSL issues in the **MySQL** connector. - **Kafka** connector certificates are now encrypted at creation time. - Updated: **Kafka** nested JSON fields extraction; metadata extraction may need to be re-run if your Kafka source contains nested fields. ### Data Processing Engine - Improved `SparkSession` acquisition for Custom PySpark Actions. - **⚠️ PySpark 3.3.2 Deprecation:** Creating new actions with **PySpark 3.3.2** is no longer possible. This version is being deprecated — please migrate to a newer PySpark version. ### Lakehouse Manager - **Trino:** Updated Trino version to **479**. - **Direct Query in Explorer:** Added direct query support in the Lakehouse Explorer. If your source is direct-query enabled, its tables and extracted attributes are now visible directly in the Explorer. - **Fixes:** Fixed encryption of nested parameters (particularly for Kafka databases). ### Analytics Manager - **Fixes:** - Resolved an issue with the `dashboard/deployed` endpoint. - Ensured resource groups are created during seed even when no JSON body is provided. ### Control Center - **Fixes:** Fixed `endDate` handling in the Control Center Logs Explorer. --- ## February 23, 2026 ### General - **Fixes:** - Environment selected in workflow preferences now properly retained. - Clicking metrics icon now redirects directly to the metrics page. - Deployment `start_date` now properly taken into account in Control Center Logs Explorer. - IAM auth provider `active` button now correctly reflects state. ### Lakehouse Manager - **Updates:** Updated Trino version from **476** to **478**. - **Performance:** Improved catalog reload time by approximately 2-3×. - **Fixes:** Fixed 401 errors on queries immediately after project creation. --- ## February 9, 2026 ### General - **Fixes:** - Fixed infinite loading spinner issue in Consumers section. - Enhanced platform stability with backend improvements and dependency upgrades. ### Connectors - **API Connectors:** Improvements and fixes for API connectors to enhance reliability and user experience. ### APPs & APIs - **Superset Theming:** Introduced a new theming module for Superset, allowing for better customization and branding options. - **Updates:** Updated Superset Template to version 6. ### Lakehouse Manager - **Performance:** Minor improvements to query stability and monitoring capabilities. --- ## January 26, 2026 ### General - **UI Refresh:** Rename **Data Catalog** to **Connectors** across the entire platform for improved clarity and consistency. - Update all navigation menus, documentation links, and sidebar references to reflect this change. - The functionality remains the same - this is purely a naming update to better represent the service's purpose as your central repository for data source connections. - **Fixes:** - Fix issue where Current Project usage had multiple supersets being displayed. Now displays just one superset column with total consumption, similar to how it's shown for apps and APIs. - Fix issue where users were unable to grant write access on policy tags. - Added a visual indicator when sorting table columns. - Improved overall platform stability and performance. - Enhanced user interface responsiveness across various components. ### Data Processing Engine - **Fixes:** - Show more accurate last 24 hours view in DPE metrics. - Fix issue where environment variables section was missing on PySpark actions. ### Documentation Updates - Updated all documentation references from "Data Catalog" to "Connectors" - Refreshed navigation and sidebar structure to reflect the new naming convention - Use "Connectors" terminology consistently in all tutorials and guides --- ## January 12, 2026 ### General - **Fixes:** - Fix infinite redirect loop that occurred when navigating away from the MFA (Multi-Factor Authentication) validation flow, ensuring a smoother authentication experience. - Resolve issue where users at the organization level could not add specific services to favorites in the sidebar. - Improved API dashboard precision by truncating numeric values to two decimal places. This makes the data display clearer and more consistent. - Enhance error handling and user-facing messages for quota management. Provide more informative feedback when quota limits are reached or exceeded. ### Lakehouse Manager - **Time Travel:** Introduced retention period for time-travel feature, by default it's **14 days**. [Read more on the doc](/en/product/lakehouse-manager/tables/time-travel.md). - **Trino Optimization:** Optimized Trino memory usage to prevent Out-of-Memory (OOM) errors, improving query stability and performance for large datasets. - **Table Maintenance:** Enabled the table maintenance job in production. This daily automated job removes old snapshots and orphan files, helping to optimize storage usage and maintain data lakehouse health. ### Data Processing Engine - **Reverse-ETL Actions:** Added support for protocol as a destination option in reverse-ETL actions. - **PySpark Load/Aggregate:** Fix issue with XLS file processing in classic PySpark load and aggregate actions. ### APPs & APIs - **Deployment Status:** Improved deployment status updates with more accurate real-time information during app and API deployment processes. - **View Logs:** Added a new "View Logs" button that appears when an app or API is deployed. - **Open Button:** Display "Open" button only once app or API is fully deployed, preventing proxy error messages that previously appeared when attempting to access services before deployment completion. --- ## December 17, 2025 ### General - **Fixes:** - Resolved an issue where boolean values were not displayed in query results when executing queries in Lakehouse Manager Explorer or Analytics Manager. - Fixed an issue where incorrect data was displayed when switching between 7 days and 24 hours views in job metrics. - Group names are now correctly shown in the UI after granting access to a group on a policy tag. ### Data Catalog - **Google Analytics Connector:** Updated the Google Analytics connector with enhanced functionality. [Learn more about the Google Analytics Connector](/en/product/connectors/sources/connectors/google-analytics/index.md). ### Lakehouse Manager - **Time Travel:** Introduced time travel feature for tables, enabling you to query historical versions of your data. [Learn more about Time Travel](/en/product/lakehouse-manager/tables/time-travel.md). - **Explorer:** Enhanced SQL query capabilities to support Iceberg snapshot version syntax using `FOR VERSION AS OF SNAPSHOT_ID`. - Improved Trino stability for more reliable query execution. ### Data Processing Engine - **Metrics:** DPE Actions and Workflows job metrics now include timed-out executions alongside successful and failed ones, for more comprehensive monitoring. - **Fixes:** - Resolved an issue where loading multiple Parquet files from a bucket with segmentation would fail when running multiple instances in parallel. - Restored the missing Python code sample in the dialog box when viewing API examples under DPE Actions and Workflows **Preferences > Triggers**. --- ## December 1, 2025 ### General - **Project-Level Search:** Introduced a new search functionality within the project level to quickly find menus and sections. Use **CMD+K** on Mac or **CTRL+K** on Windows to access this feature. - **Quotas:** New Quotas feature now available in the organization settings page, allowing administrators to manage resource allocation limits. [Learn more about Quotas](/en/product/organisations/orga_settings?id=quotas). - **Performance:** Improved job performance across the platform. ### Lakehouse Manager - **REST Catalog:** Deployed a new open-source REST catalog service (Polaris) for Apache Iceberg to prepare for future integrations, such as enhanced table metadata access and more granular RBAC. - Fixed ACLs issue with policy tags. ### Data Processing Engine - **Notebooks:** Python 3.9 notebooks can no longer be created; **Python 3.13** is now the default version. - **Fixes:** - Resolved an issue where `S3Store.bucket_exists()` encountered errors when saving status with multiple workers during `get_bucket` operations. - Fixed PySpark linked environment parameter handling to properly support number and boolean types (previously only string values worked correctly). --- ## November 17, 2025 ### General - During project creation, hostnames no longer accept underscores to ensure better compatibility. ### Data Catalog - **Kafka Connector:** Improved performance with faster and more efficient batch loading into datasets. - Fixed timezone handling in metadata extraction for more accurate data processing. ### Data Processing Engine - **Workflows:** Added `Force Rebuild` option, matching the functionality previously available in actions (useful for troubleshooting and ensuring clean re-execution). - **Custom Actions:** Added support for **Python 3.13**. - **PySpark Actions:** Fixed environment variable handling to properly support number and boolean types when using linked environments (previously only string values worked correctly). - **Spark Custom Actions:** Enhanced boilerplate templates for improved developer experience. --- ## November 3, 2025 ### ⚠️ Important Actions Required ⚠️ - **Front-end Applications with MFA:** Due to a security patch, applications using project-level authentication with Multi-Factor Authentication (MFA) require a manual update. Users must update the `client-authority-manager` dependency to version `1.5.0` in their `forepaas.json` file (located in the root folder of the Front App), then rebuild and redeploy the application. ### General - Platform-wide infrastructure improvements for enhanced stability. - **Security:** Improved token rotation when switching between organizations and increased authenticator secret length for better MFA compatibility. ### Data Catalog - **Kafka Connector:** Now returns flattened JSON by default for easier processing. - **Source Management:** Columns using [reserved keywords](/en/product/lakehouse-manager/tables/index.md?id=reserved-words) are now automatically renamed with an `_r` suffix to prevent SQL query and table build failures. ### Data Processing Engine - **Jupyter AI Extension:** Notebooks now include the Jupyter AI extension for conversational assistance. Setup is required with your OVHcloud AI endpoint key. - **Notebooks:** - Improved startup time with asynchronous post-start processes. - New resource usage metrics (CPU, Memory, Storage) are now displayed. - Fixed an issue preventing the override of existing dependencies. - Updated example notebooks and boilerplates. - Resolved compatibility issues with Spark versions 3.4.4 and 3.5.5. ### Lakehouse Manager - **SDK Update:** Added a new [`create_from_physical`](/en/technical/sdk/dpe/connect-dm.md?id=create_from_physicaltable-dataset39default_dataset39-kwargs) method to create logical objects from existing physical tables. - Improved stability for configuration imports by correctly setting table statuses. ### Analytics Manager - Fixed out-of-memory issues in Trino to enhance query performance and stability. ### APPs & APIs - There are no specific updates for this section in this release beyond the security patch mentioned above. ### Documentation Updates - **Tutorials Hub:** Replaces the previous Tutorials section, organizing learning materials into clear categories such as project setup, data ingestion, transformation, export, analysis with Trino, and business intelligence. - **[Jupyter AI Extension](/en/product/dpe/notebooks/notebooks-ai-extension.md):** New guide for the built-in Jupyter AI extension, including setup with your OVHcloud AI endpoint key and using conversational assistance in notebooks. - **[SQL Transformation Guide](/en/getting-further/sql-transformation/index.md):** Step-by-step examples showing how to perform SQL-based data transformations within notebooks on the data platform. - **SDK Reference:** Updated with new [dataset connector methods](/en/technical/sdk/dpe/connect-dm.md); more updates coming in future releases. - **Link Fixes:** Several broken links across the documentation have been corrected for better navigation. --- ## October 20, 2025 ### General - Platform-wide dependency upgrades for enhanced stability and security. - Fixed an issue where the Power BI connector was returning the wrong subdomain when sharing Project URLs. ### Data Processing Engine - Default Spark version updated to **3.5.5** for load and aggregate actions - Updated SDK to latest versions of **Pandas 2.x** and **SQLAlchemy 2.x**, improving notebook compatibility. - Added support for **Python 3.13** with updated base, PySpark, TensorFlow, and DataScience notebook images - New example notebooks included with every notebook image. ### Data Catalog - Added **NDJSON** format support for JSON uploads. --- ## October 6, 2025 ### ⚠️ Important Actions Required ⚠️ - **For Apache Superset (using the SQLite template) built before October 6th:** Clients must rebuild and redeploy the environment to ensure compatibility and support. - **For the Front Application built before October 6th:** Clients must update the SDK to version **1.3.0** in `forepaas.json`, then rebuild and redeploy the application. ### General - Improved SSO login flow to only display auto-provisioned options where applicable - Fixed navigation, loading, and multi-button hover issues in UI - Database connectors now display warnings and documentation links ### Data Processing Engine - Fixed issues with PySpark actions and aggregate action reliability - Updated Oracle and Polar connectors for improved compatibility - New warning when changing destinations with multiple sources ### Lakehouse Manager - Fixed missing access rights for job endpoints (users now need explicit rights) - Improve stability and performance - Added Metastore service to handle metadata more efficiently - Fixed logical attribute build issue with incremental updates. - Polaris catalog deployed for open-source REST compatibility ### Analytics Manager - Fixed ACL-related constraints for endpoints - Configuration service updated for improved Trino catalog compatibility ### Apps & APIs - Fixed automatic deployment issues - Optimized Superset builds. - Updated store templates and SDK modules --- ## September 22, 2025 ### General - Minor bug fixes and improvements --- ## September 8, 2025 ### General - Improved error handling and log sanitization to make troubleshooting smoother and more secure. - Fixed errors with invalid parameters in the Log Explorer. ### Data Catalog - Improved OVHAPI Connector with enhanced V2 compatibility ### Data Processing Engine - Updated Python environment to *v3.13.7* for improved security and compatibility. - Enhanced logs for easier debugging. - Improved PySpark execution reliability, reducing warnings and errors during workload runs. - Fixed an issue with SQL Server installation dependencies to ensure smoother deployments ### Lakehouse Manager - Better error message handling when importing configurations to simplify troubleshooting - Stability improvements across Lakehouse query services. --- ## August 25, 2025 ### General - [**Consumers**](/en/product/connectors/consumers/index.md) have now been moved to the [Lakehouse Manager](/en/product/lakehouse-manager/index.md) - Improved logs for the Lakehouse Manager "all-in-one" build action. - Fixed an issue where "all-in-one" action reports a successful metadata update (update metas successful) but returns a result of -1. --- ## August 11, 2025 ### General - Trino version upgrade v461 to v476 - PowerBI consumer is now available for use. guide on how to use is available [here](/en/product/connectors/consumers/power-bi/index.md) - Fixed minor issue with the edit icon not appearing on DPE actions/workflows/environments. --- ## July 28, 2025 ### General - Improved ACL for actions for Data Processing Engine - New tutorial available for a FinOps uses case with FOCUS and superset - [here](/en/getting-further/finops-focus-superset/index) --- ## July 15, 2025 ### General - Apache Superset is now availalable in the App Service - Adjusted Spark log levels and optimized processing for better performance - Introduced the [NYC Taxi dataset tutorial](/en/getting-further/pyspark/index.md) with two practical examples and a [PySpark cheat sheet](/en/getting-further/pyspark/pyspark-cheatsheet.md) for enhanced learning and quick reference. ### Data Processing Engine - Added new metrics to monitor notebook usage and performance - Improved notebook import/export experience for better usability - Improved documentation for [PySpark modules](/en/technical/sdk/dpe/connect-spark.md) and PySpark [use cases](/en/technical/sdk/dpe/quick-start-spark.md), making it easier to leverage distributed processing. - Added comprehensive documentation for previously missing Data Processing Engine (DPE) [actions](/en/product/dpe/actions/index.md), expanding available guides. ### UI / Platform - Fixed an issue where Log Explorer wouldn’t display the bottom of the window correctly - Resolved a WebSocket issue when multiple users accessed the same DPE - You can now add widgets directly without going through the edit menu - Updated DPE Notebooks interface for a smoother experience - S3-compatible storage now automatically lowercases the region field for consistency --- ## June 30, 2025 ### General - Project's home: update "APPLICATION SERVICES" tile by merging "Apps" and "APIs" tiles - Improve OAuth integration with MFA ### Data Processing Engine - All Actions: Added a **Force Rebuild** option, useful for troubleshooting and ensuring a clean re-execution. - PySpark Actions: added selection of appropriate "Spark Log Level" - PySpark Custom Action: added selectition of PySpark version (currently 3.3.2, 3.4.4, 3.5.5) ### Lakehouse manager - various optimisation and bugfixes ### Control Center - Logs Explorer improvements - Jobs Central: fix Last 30 days display --- ## June 9, 2025 ### Data Processing Engine - PySpark Load: allow multiple files loading from Bucket ### Control Center - Logs Explorer: fix when last second of logs were sometimes not displayed --- ## May 26, 2025 ### Data Catalog - Added JSONPath support to OVH API sources for simpler data navigation. - Improved performance of OVH API sources for quicker data access. - Made it easier to manage multiple endpoints in OVH API sources. ### Data Processing Engine - New Action - Export Table to Source: Export selected tables from your lakehouse to an external data source. - Fixed the Time Breakdown view in job details for accurate insights into job performance. - Resolved an issue preventing users from leaving the editing page in certain actions without refreshing. - Improved notebook usability with a pending status display when stopping a notebook. - Enhanced metrics for better monitoring. - Optimized Spark processing for improved performance and reliability. - Adjusted Spark log levels for clearer debugging and monitoring. - Fixed an issue with incorrect start dates in Logs Explorer for accurate job tracking. - Fixed incomplete display of last 24 hours metrics for accurate monitoring. - Reworked notebook access controls to include read-only support for better collaboration. ### Analytics Manager - Improved query menu interface with a clear display of visual or SQL mode on the main page. - Enhanced handling of queries to support virtual attributes, ensuring reliable performance. ### Lakehouse Manager - Fixed an issue where copying tables with a large number of attributes caused errors. - Resolved errors during Physical Build stops for smoother operations. - Standardized metadata extraction for better data consistency. - Added physical build status checks by job type for improved monitoring. --- ## May 12, 2025 ### General - New [tutorial](/en/getting-further/billing-OVHapi/index.md) to use OVH API Connector for billing analytics ### Data Catalog - Better handling of date time string with UTC time zone - Improved Analyzer for streaming sources - Improved OVH API connector - Improved handling of PostgreSQL source using Direct Query and integration with Trino ### Data Processing Engine - Python SDK: we have fixed package **boto3 < 1.36.0.** - **⚠️ Note:** For compatibility reasons, please do not include the boto3 library in your custom dependencies --- ## April 28, 2025 ### General - Improved login page text for a better experience. - Tutorials and documentation now open in a new tab from the homepage. - Updated text on the Analytics Manager and SQL Queries screens. - Simplified organization invitations by removing the "create an organization" option. - Fixed occasional issues when searching in the policy tag list. - Fixed action links in Notebooks to better reflect user's permissions. - Improved user list visibility when managing organization/project invites. - Improved display of logs in the Control Center. ### Data Processing Engine - Fixed toolbar icon display in Advanced Mode for better usability. - Improved stability after notebook crashes, with better disk restoration. ### Lakehouse Manager - Improved dataset status updates. - Improved performance of physical builds. --- ## April 14, 2025 ### General - Several UI fixes in Organization's pages and Identity Access Manager ### Data Proessing Engine - Fix File Transfer Action - In logs, add Action's name when just Action's ID was visible - Fix some logs visibility in Action / Workflow / Job view. ### Lakehouse Manager - Improve dataset creation time - Better handling of Explorer when Trino is not available ### Control Center - Fix display of some Monitoring views --- ## March 28, 2025 ### General - Enhanced dataset creation flow for a more user-friendly experience. - Fixed minor bugs related to policy tags. - Resolved an issue where Control Center logs were not displaying correctly. ### Data Processing Engine - Enhanced logging for PySpark actions to improve traceability and debugging. - Improved OVHcloud API connector for better handling of multiple endpoints. - Notebooks: - Added support for Python 3.11 - Introduced new Data Science and TensorFlow notebook types. --- ## March 18, 2025 ### General - Documentation is now available at https://docs.dataplatform.ovh.net/ - Improve handling of logins mixing upper and lower cases - Improve readability of some error messages - Update project is ready e-mail - Remove all UI references to BETA ### Data Processing Engine - Streamline events exchange with UI - Notebooks: update Data Platform Python SDK ### Lakehouse Manager - Improve all-in-one action to better handle attributes names --- ### Changelog prior to the GA
Expand here --- ## Feb 29th 2024 ### Platform - Several bug fixes and improvements --- ## Feb 22nd 2024 ### Platform - Several bug fixes and improvements --- ## Feb 15th 2024 ### Platform - Several bug fixes and improvements --- ## Feb 8th 2024 ### Platform - Several bug fixes and improvements --- ## Feb 1st 2024 ### Platform - Updated ForePaaS logos to OVHcloud logo ### Analytics Manager - Fixed history metrics not being returned correctly --- ## Jan 25th 2024 ### Data Processing Engine - Removed logs that are not formatted correctly --- ## Jan 18th 2024 ### Analytics Manager - Fixed queries, APIs and applications returning an error when trying to query data from standard Lakehouse Manager datasets. ### AI App Builder - Removed repeated column in Knowledge Bases list - Visual fixes and improvements ### Storage Engines - Sorted storage engines list in alphabetical order - Added a 'Location' filter for interface - Updated 'Engine' filter to filter the interface on the type of engine ### Platform - Updated Profile & Profile > Security pages to be in auto-save mode --- ## Jan 11th 2024 ### Lakehouse Manager - Removed check on last dataset preventing to delete it - Added warning message when trying to delete a dataset used in Machine Learning Manager ### Support Portal - Fixed 'Open in a new tab' option not being available for support cases - Fixed direct URL opening of a support case redirecting to the portal home --- ## Dec 28th 2023 ### Platform - Several bug fixes and improvements --- ## Dec 21th 2023 ### Lakehouse Manager - Fixed query estimator still appearing when failed - Fixed display of type in datasets list - Fixed bugs on the import and export of configurations ### AI App Builder - Added redirection link to linked app from assistant interface - Updated possible options from the home of the project ### Identity Access Manager - Fixed appearance of MFA feature --- ## Dec 14th 2023 ### Lakehouse Manager - Updated 'Associated resources' table in policy tag page to show attributes' table - Added sections in sidebar of Lakehouse ### Platform - Added template for AI App Builder --- ## Dec 8th 2023 ### Lakehouse Manager - Fixed name and type of datasets sometimes not displaying correctly ### Platform - Added confirmation modal before stopping a running job - Fixed tile sometimes being blank after adding service in project --- ## Nov 30th 2023 ### Platform - Fixed sidebar links not working when there is no project in organization ### Data Processing Engine - Improved Aggregate action to support manual adding of GROUP BY --- ## Nov 23rd 2023 ### Identity Access Manager - Added OVH logo for emails. - Bugfixed login without authentication provider except ovh. ### Data Processing Engine - Added message block when creating pyspark action from action. ### Lakehouse Manager - Fixed search in groups/users when adding policy tags. - Fixed display of policy tags in table / tree view. --- ## Nov 16nd 2023 ### Lakehouse Manager - Added interface to grant access to policy tags directly from Lakehouse Manager - Fixed queries running automatically when opening Explorer - Fixed attributes being duplicated twice when duplicating a table - Multiple bug fixes and improvements related to the build status of tables ### Data Processing Engine - Python 3.6 is now decommissioned. All actions and workflows have been migrated to the next available version. - Added option to create a PySpark action when a Python Load/Aggregate action is detected to insert data in a Lakehouse Manager dataset. --- ## Nov 9nd 2023 ### Lakehouse Manager - Multiple bug fixes and performance improvements ### Analytics Manager - Fixed a bug where it was impossible for a new user to login to the deployed-live dashboard URL - Added a confirmation modal before deactivating a query engine ### Platform - Updated password validation rules in the profile --- ## Nov 2nd 2023 ### Storage Engines - Reworked pages for *Storage Engines* service in the interface: *Storage Engines* can now be opened as a standalone service from either the main sidebar or the services list. ### Lakehouse Manager - Fixed file size ordering not working in Buckets - Multiple bug fixes and improvements to Datasets and Tables ### Analytics Manager - Added a link to the query when an error occurred in a dashboard ### Identity Access Manager - Fixed a bug when logging-in using login/password would not not work --- ## Oct 26th 2023 ### Platform - Added link to projects' templates' store in the services list - Added locked visual in sidebar and header if no permission to header - Removed some unused permissions in organization IAM - Improved error message when reseting password ### Data Manager - Data Manager service has been split in **Data Catalog** and **Lakehouse Manager**. - Data Manager graphical interface is depreciated ### Lakehouse Manager - Introducing Lakehouse Manager! - Lakehouse Manager is a serverless data warehouse to store and organize any dataset - You can now create custom datasets - You can now create policy tags for Advanced Data Access Control ### Data Catalog - Introducing Data Catalog! - Data Catalog allows you to define connections and data assets across your organization ### Data Processing Engine - Added a new action: *CSV to PostgreSQL* ### Identity Access Manager - Removed incorrect display of 'Log History' feature for DataplantID and API key authentication methods --- ## Oct 19th 2023 ### Platform - Multiple bug fixes and improvements ### Applications - Fixed metric of FPU in APIs/apps not displaying correct value --- ## Oct 12th 2023 ### Platform - "Organization not found" page will be showed for invalid link. - Increased text area size on Support portal page. - Fixed default configuration of storage engine when create new project. ### Data Manager - Fixed secret+key label missing for 'S3-compatible storage' source ### Data Processing Engine - Changed source icon size. - Time format updated. ### Machine Learning Manager - Time format updated. ### Analytics Manager - Analytics Manager is now generally available --- ## Oct 5th 2023 ### Analytics Manager - Analytics Manager Dashboards are now in Beta release - Fixed access to live deployed dashboard ### Data Processing Engine - Fixed duration not showing when it is under 1 second ### Application Services - Fixed certificate management for apps - Fixed configuration for login screens disappearing --- ## Sep 28th 2023 ### Platform - Fixed long projects/organizations names being shortened with ellipsis ### Data Processing Engine - Fixed bug for repo version override - Removed app_id & type query strings from the code snippet to launch an action/workflow ### App Manager - Fixed a bug where it was impossible to remove a tag --- ## Sep 21st 2023 ### Platform - Fixed a bug where the Storage Engines page would be accessible but empty if user has no permission on storage engine instances. The page is now un-accessible in this case - Fixed bug where the list of invites (to organizations) on the profile page would be inaccurate - Fixed support page layout ### Data Processing Engine - Fixed default version in actions being Python 3.11 --- ## Sep 14th 2023 ### Platform - We are rolling out a major update to the backend of the organization's IAM! Performances and stability are much improved on all of the platform pages. - Updated sign-in screen when session is timed out inside a project --- ## Sep 7th 2023 ### Platform - Add option to sign in / sign up to ForePaaS using OVHcloud account ### Application Services - Fixed automatic deployment when creating app/api --- ## Aug 31th 2023 ### Data Processing Engine - Added possibility to order/limit when listing objects by API ### Data Manager - Added possibility to order/limit when listing objects by API ### Machine Learning Manager - Added possibility to order/limit when listing objects by API --- ## Aug 24th 2023 ### Data Processing Engine - The version of PySpark is now displayed in Custom PySpark actions - The minor version number for Python is no longer displayed in the interface ### Machine Learning Manager - The minor version number for Python is no longer displayed in the interface ### Analytics Manager - Fixed displaying of paywall based on query engine activation ### Control Center - Added support for quotas. You can manage Control Center quotas in the Settings of the CC - Fixed redirection to Control Center in the header which sometimes opened the wrong organization --- ## Aug 17th 2023 ### Platform - Various bug fixes and improvements --- ## Aug 10th 2023 ### Data Manager - Various bug fixes and improvements --- ## Aug 3rd 2023 ### Data Manager - Added two new connectors: **Shadow Drive**, and **Google Cloud Storage**. - Fixed verify_ssl option for OpenSearch connector to be false by default - Added a data type for virtual attributes on creation - Fixed a bug when creating an index with 2 attributes on a PostgreSQL table ### Data Processing Engine - Fixed a bug where the service would be softlocked if Control Center is unresponsive --- ## Jul 27th 2023 ### Platform - Fixed status member pending till he creates his account - Fixed access to project being available if creation aborted ### Analytics Manager - Added support to `eq` and `ne` operators for JSON queries --- ## Jul 20th 2023 ### Platform - Bug fixes and performances improvements --- ## Jul 13th 2023 ### Storage Engines - Introducing a new engine in Alpha release: Polar Data. Polar Data is a modern lakehouse engine built by ForePaaS. ### Data Manager - Explorer can now be used without activating a query engine *(currently only available on projects deployed on OVHcloud provider)* --- ## Jul 6th 2023 ### Platform - Multiple improvements to the display performances of home page - Added tooltips on kpis of project home - Make editing message on project home always visible - Fixed status of project when adding a service - Fixed sidebar projects sometimes not up to date - Fixed free fpu included in organization overview --- ## Jun 29th 2023 ### Platform - Performance improvements and multiple bug fixes to the new home pages and navigation ### Analytics Manager - Added new option to export query result to ForePaaS Buckets, and receive the download link by email. Use this option if your query results are bigger than 10 MB and you cannot use the local download. --- ## Jun 22th 2023 ### Platform - Introducing ForePaaS Home v2! - Dataplants are now called Projects! They can be made of any number of services bundled together - A new header allowing to navigate between services, projects and organizations - A new sidebar allowing to navigate between services - A new organization home page introducing widgets and a 'recently opened' section - A new project home page where you can edit the layout and get detailed metrics - Projects can now be created from templates, allowing to get started with only some services before expanding to others --- ## Jun 15th 2023 ### Control Center - Fixed bug on logs streaming endpoint --- ## Jun 9th 2023 ### Platform - Fixed opening of versioning panel in Data Processing Engine, Analytics Manager and Machine Learning Manager ### Analytics Manager - Migrated all queries from Query Builder Legacy to Analytics Manager, in a new repository "QB Queries" - Query Builder Legacy is now removed from the console and decommissioned from the ForePaaS Platform ### Data Processing Engine - Added possibility for Custom actions and Load actions using a streaming-type connector to have no timeout, if the job's execution mode is Always-up - Fixed an issue on MQTT connector related to the acknowledgement of message consumption that would sometimes cause a timeout of the connection --- ## Jun 1st 2023 ### Platform - Fixed buttons sometimes disappearing on lists if a column was enlarged a lot ### Analytics Manager - Fixed attributes from MART Tables not appearing in the choice of the query editor - History loading is now better handled in Analytics Manager & Data Mnaager Explorer ### Data Processing Engine - Statistics about insert/update are now disabled by default in order to optimize performances - Parameter `statistics` is now false by default in the *bulk_insert* SDK function - Statistics about insert/update are now computed only if the log level of a job is set to *DEBUG* --- ## May 25th 2023 ### Data Manager - Fixed preview table button sometimes previewing wrong attributes ### Analytics Manager - Fixed regrouped attributes which sometimes would appear in wrong order on a bar chart --- ## May 11th 2023 ### Data Manager - Added a warning when linking a storage engine that is not in the same location as the Dataplant - Fixed translation issues in some modals - Fixed arguments not being correctly required on MongoDB connector ### Analytics Manager - Fixed queries not running if Japanese characters were in the title - Fixed virtual attributes sometimes not appearing in the options for the visual query builder - Fixed gauge chart not taking the dashboard's chart into account --- ## May 4th 2023 ### Analytics Manager - Added a new chart type: **gauge chart**. Make sure your projects are on-track and monitor how far KPIs are from reaching targets with this new visualization type! - Added new option to break the X-axis down into multiple attributes, in order to regroup bar charts, line charts and area charts by specific Scale attributes - Added more fine-grained *origin* types for the query history, with hyperlinks to the relevant object ### Data Processing Engine - Increased the size of a workflow's visual interface, in order to make the name of its actions more visible - Fixed a bug on the workflow version override which would sometimes not take effect ### Identity Access Manager - Fixed a bug on the service selection in the role condition builder --- ## Apr 27th 2023 ### Data Manager - Added a *type* parameter for virtual attributes - Fixed "port" parameter in MQTT connector ### Analytics Manager - Added a more fine-grained origin for queries in History - Added a more fine-grained status for queries in History - Tiles/filters are now automatically removed from dashboards if the related query is deleted ### Data Processing Engine - Added a new action: *MySQL to Parquet* - Fixed a bug where the status of a workflow would sometimes not reflect the status of stages --- ## Apr 20th 2023 ### Data Manager - Bug fixed on MQTT connector ### Analytics Manager - Small cosmetic improvements to dashboards --- ## Apr 13th 2023 ### Data Processing Engine - Python 3.6.5 is now depreciated. Please migrate all your actions to the next stable version of Python: 3.9.9 - Python 3.6.5 will be fully decommissioned on **October 19th 2023** - Fixed multiple git conflicts ### Data Manager - Added Location column when binding a new storage engine, and 'recommended' tag if the storage engine is in the same location as dataplant - Fixed logs in console being swapped when launching another job ### Machine Learning Manager - Python 3.6.5 is now depreciated. Please migrate all your pipelines to the next stable version of Python: 3.9.9 - Python 3.6.5 will be fully decommissioned on **October 19th 2023** --- ## Apr 6th 2023 ### Data Processing Engine - Added support for **Python 3.11** - Added merge conflict user warning for Git versioning ### Analytics Manager - Keep attributes sorted in the same order when previewing a table from the Data Manager ### Application Services - Multiple bug fixes on timeout after building - Better handle when build finish job --- ## Mar 30th 2023 ### Data Processing Engine - Alerts integration in DPE Workflow UI. - Confirm popin if creating a workflow with actions that use different Python versions. ### Analytics Manager - Improved animation to display edit chart settings panel in dashboard. - For Pie charts group data together if more than 20. - Fixed reload jobs and logs in logs explorer ### Control Center - Reload of jobs in Logs Explorer has been fixed. --- ## Mar 23rd 2023 ### Analytics Manager - Added inversion evolution colors and displaying dimension. - Bug fixed where offset percentiles labels so that they don't overlap. ### Data Processing Engine - Alerts tab in Actions to create Control Center Alerts. - Actions/workflows names can be clicked in Jobs tab to redirect to the action/workflow. ### Machine Learning Manager - Pipeline names can be clicked in Jobs tab to redirect to the pipeline. --- ## Mar 16th 2023 ### Analytics Manager - Added *trend line* option in the settings of scatterplot - Fixed red error message if user has no access to IAM - Fixed duplicate attributes appearing in query creation choices if both virtual and physical attribute have the same name ### Applications - Multiple bug fixes ### Platform - Fixed Azure storage engine creation - Added new filters to the Jobs page statuses --- ## Mar 9th 2023 ### Analytics Manager - Added a new chart type: [*Scatterplot*](/en/product/am/queries/charts?id=use-a-scatterplot), to represent the correlation between two metrics as colored bubbles - Added possibility to edit all chart settings directly from a dashboard - Added info in query history that the query has been launched from a deployed dashboard - Fixed a bug when drilling down on a chart which already had an Order set at query level ### Data Processing Engine - Added a new action: *PostgreSQL to Parquet* - Renamed action *table-to-files* in interface and improved its visual aspect, to add an option to choose the output format - Added ability to disable stats calculation on `bulk_insert` function from SDK, in order to reduce the computing time - Disabled Always-up option for PySpark actions --- ## Mar 2nd 2023 ### Analytics Manager - Introducing the possibility to [drill-down](/en/product/am/dashboards/edit?id=drill-down-on-the-dashboard) on dashboards' charts! Click on a part of any chart in order to filter everything on related values, or to further explore relevant data. - Added option to download the content of a dashboard's tile as a CSV - Fixed timepicker's display reseting when opening it from a dashboard - Fixed timepicker's WTD option not starting on Monday in some countries ### Control Center - Updated interface for Logs Explorer in streaming mode in order to stick to the bottom of page when new logs appear --- ## Feb 23th 2023 ### Analytics Manager - Added *Download as a CSV* option to export the result of query as a tab-separated .CSV local file (limited to 10 MB) ### Data Processing Engine - Disabled possibility in GUI to mix standard and PySpark actions in the same workflow - Fixed environement variables automatically opening in preferences - Fixed language version override on workflows sometimes not displaying ### Control Center - Fixed logs sometimes being displayed on same line when streaming - Redirecting to the logs explorer from another component now switches Streaming mode on if it is a currently running job ### Platform - Fixed drag and dropping repositories which would sometimes randomize their order - Renamed job status from Pending to Running - Fixed search if category selected --- ## Feb 20th 2023 ### Data Processing Engine - Added a parameter *apply_rules* (default value = *false*) in function `extract` of the SDK in order to apply blueprint of rules. ### Analytics Manager - Added *Copy to clipboard* option to copy the result of query to the clipboard (limited to 1 MB) - Replaced the dashboard subtitle by the dashboard's description - Improved the default visual aspect of some charts - Updated the options for the size of query engine. 4 FPU-S is now XS, and added a new coming soon option: XL (64 PFU-S). - Fixed visual display bugs on dashboard tiles (tooltip or options that would sometimes go behind the tile) ### Data Manager - Fixed a bug in Trino connector where it would return an error `'Trino' object has no attribute '_read_sql'` ### Control Center - In Logs Explorer, clicking on refresh now refreshes the list of executions for jobs ### Platform - Added repository_id in url of following pages: DPE Actions, MLM Pipelines, AM Queries - Fixed a bug where double clicking on folder would create subfolder with same name --- ## Feb 9th 2023 ### Platform - Fixed drag and drop of files into folder which was sometimes failing - Fixed display of delete confirmation modal when too many objects are in it - Increased size of description ticket in Support portal ### Analytics Manager - Added option to compare to previous period in [Metric](https://docs.dataplatform.ovh.net/#/en/product/am/queries/charts?id=use-a-metric) chart! - Improved visual aspect of big number - Improved drag and drop of tiles to include an auto-scroll at the top and bottom of dashboard - Fixed filter dropdown that would sometimes go behind a tile - Fixed "Filter on" option at the bottom of the filter - Updated text if no deployed dashboard in the dashboards portal ### Data Processing Engine - Updated PySpark version from 3.1.1 to **3.2.1** - Fixed bug when committing changes in repo connected to git - Fixed the display Building status when simply saving action ### Machine Learning Manager - Made the pipeline ID in a job clickable ### Control Center - Added icons to show status of execution id's in Log Explorer - Removed delete icon for ForePaaS monitoring panels (in multi-select) --- ## Feb 2nd 2023 ### Platform - Updated label color and button's grey. - Fixed table width. ### Analytics Manager - Added dashboards portal. - Optimized dashboards render. - Fixed redirection to logs in the Control Center from a resource. ### Data Manager - Fixed loader in Table load. --- ## Jan 26th 2023 ### Analytics Manager - Added a new chart type: [Metric](/en/product/am/queries/charts?id=use-a-metric), to display a query result as a single big number! - Greatly improved vertical resizing of dashboard tiles to be pixel perfect instead of by steps - You can now choose to add a time to your date filter in a dashboard if the filter is set on [*Date & Time*](/en/product/am/dashboards/edit?id=edit-advanced-filter-options) - Increased the limit of tiles per row from 4 to 8 (tiles can now be smaller) - Switched icon for successful autosave in dashboard to green - Fixed scroll in query preview if error - Fixed message when query does not exist in a dashboard - Fixed labels being hidden in a pie chart in dashboards with no reason ### Control Center - The Control Center is now in General Availability! - Infrastructure Monitoring Legacy interface has been decommissioned - Added possibility to notify subscribers when an alert is resolved ### Data Processing Engine - Fixed a bug where a workflow would be stuck at a stage (despite all its actions successfully finishing) and would timeout ### Application Services - Fixed creation of app using custom template ### Platform - Improvements of the linking of storage engines with Dataplants - Added a tutorial on [how to upload custom app templates to the ForePaaS Store](/en/technical/api-reference/store/index.md) --- ## Jan 19th 2023 ### Analytics Manager - You can now filter absolute and relative dates in your dashboards using the **Date** and **Date & Time** filter types! - Added Boolean filter type - Added possibility to change filter type in the advanced filter options - Fixed sql query not executed in dashboards if configuration empty - Fixed display button back to dashboard if no dashboard ### Data Processing Engine - Add log for operator elected - Fixed watch_jobs ignore not initialised or stopped job - Fixed skip instead of stop if error happens --- ## Jan 16th 2023 ### Platform - Improved performances for support interface --- ## Jan 12th 2023 ### Analytics Manager - Introducing [Dashboards](/en/product/am/dashboards/index)! A modern and simple BI tool for super fast dataviz and reporting. Using the next-gen Analytics Manager query engines, your data visualisation and querying can easily scale up to Big Data and beyond. - Dashboards are currently in Alpha release in Analytics Manager. ### Identity Access Manager - Added compatibility for CEL conditions on *Analytics Manager* service. --- ## Jan 6th 2023 Happy New Year! ForePaaS and OVHcloud wish you the most successful data projects for 2023! 🎉🎉 ### Platform - Performances improvements --- ## Week 52 **Date:** 29/12/2022 ### Platform - Bug fixes and performances improvements --- ## Week 51 **Date:** 22/12/2022 ### Platform - Bug fixes and performances improvements --- ## Week 50 **Date:** 15/12/2022 ### Platform - Bug fixes and performances improvements --- ## Week 49 **Date:** 08/12/2022 ### Data Processing Engine - Added option to override repository version of actions inside workflow ### Analytics Manager - Fixed chart Runtime Percentile on Overview page ### Control Center - Removed storage engine overtime chart in storage engine monitoring - Added OAuth2 support for Custom Webhook alert consumers in the interface ### Identity Access Manager - Advanced CEL conditions (technical name, etc.) are now available for services *Data Manager* and *Control Center*. --- ## Week 48 **Date:** 01/12/2022 ### Data Manager - Added a new connector in general availability: **InfluxDB** ### Control Center - Added OAuth2 support for Custom Webhook alert consumers in the API --- ## Week 47 **Date:** 24/11/2022 Happy Thanksgiving! 🎉 ### Data Manager - Added a new connector in general availability: **CockroachDB** - Fixed translation when creating a new storage engine - Fixed responsive on Buckets files list ### Identity Access Manager - Advanced CEL conditions (technical name, etc.) are now available for service *Data Processing Engine*. ### Control Center - Fixed URL when redirecting from other services to the Logs Explorer - Fixed format date of storage engines --- ## Week 46 **Date:** 17/11/2022 ### Platform - Implemented a major backend update to dramatically improve the performance and availability of the ForePaaS console. Among other things, this update significantly increases the stability and speed of access to your Dataplants and other organization-level services. ### Data Processing Engine - Logs window now prompts to redirect to the Control Center Logs Explorer ### Identity Access Manager - Advanced CEL conditions (technical name, etc.) are now available for service *Machine Learning Manager*. ### Control Center - Fixed display of tooltip for RPS and Latency charts in monitoring panels - Added automatic default values on triggers when creating an alert - Replaced 0 by 'Terminated' in column 'Age' of service in monitoring panels if status of pod is terminated ### Machine Learning Manager - Logs window now prompts to redirect to the Control Center Logs Explorer - Fixed bug on dataset generation for unstructured data ### Data Manager - Logs window now prompts to redirect to the Control Center Logs Explorer --- ## Week 45 **Date:** 10/11/2022 ### Control Center - Added all query filters in URL of Logs Explorer - Fixed a bug when logs would not match chosen timeframe after editing the datepicker to a smaller date ### Data Processing Engine - Added a new tutorial: [how to load streaming data from Apache Kafka](/en/getting-further/kafka/index) ### Machine Learning Manager - Fixed download model link ### Identity Access Manager - Added compatibility for CEL conditions on *Analytics Manager* and *Control Center* services --- ## Week 44 **Date:** 03/11/2022 ### Control Center - You can now search logs using a regex match (as well as doesn't regex match, contains, or doesn't contain) in the Logs Explorer. - Log search can now be done using Control Center API - Navigation in the header no longer blocked if user has rights on service. ### Identity Access Manager - Added compatibility for CEL conditions on *Data Processing Engine*, *Data Manager* and *Machine Learning Manager* services - Updated date format for creation date of api key in users and service account. ### Data Manager - Fixed opening of advanced panel when update table in Data Manager. ### App Service - Updated return status when user is unauthorized (403 instead of 401). - Updated to return 403 if users has no rights on applications instead of 200 and empty list. ### Data Processing Engine - Fixed concurrent job execution amongst other bugs. --- ## Week 43 **Date:** 27/10/2022 ### Control Center - Added storage engine charts in monitoring. ### Identity Access Manager - Fixed disabled when edit legacy role condition. - Updated user name with civility translated. - Translated civility (in english) in mails. - Fixed bug about group duplicate in backend. ### Machine Learning Manager - Fixed autosave when edit preferences of model. - Fixed getters prim and mart table from store. ### Data Manager - Added most queried tables chart in overview. ### Data Processing Engine - Changed settings to not ask to update environment on first launch if version deployed. ### Platform - Added loader when switch organization. --- ## Week 42 **Date:** 20/10/2022 ### Control Center - Replaced FPU consumption KPI with Dataplant count KPI ### Identity Access Manager - Bug fixes and improvements to CEL role conditions editor - Added a new tutorial: [How to set a role condition on a specific bucket](/en/getting-further/iam/conditions) ### Data Manager - Fixed reseting search filter when selecting a bucket ### Analytics Manager - Fixed count of queries in overview ### Data Processing Engine - Fixed use of databases and tables in Actions - Added visual display of when job fails because oomkill - Added tooltip on disabled options for perimeter and segmentation - Updated trigger translations ### Platform - Prevented accidentally closing the modal when adding/editing storage engine - Fixed empty size when creating new storage engine --- ## Week 41 **Date:** 13/10/2022 ### Identity Access Manager - Added compatibility for CEL conditions on *Data Store* and *App Service* services ### Data Manager - Fixed 'magnifying glass' button for a table to open a preview of the table - Fixed button switch table views - Added horizontal scrolling on the metadata analysis page ### Data Processing Engine - Fixed perimeter option not being in the correct place in the UI - Fixed missing English translation in quotas - Fixed buttons in the versioning panel - Fixed database_name in tables --- ## Week 40 **Date:** 06/10/2022 ### Control Center - Added refresh button next to the date picker - Fixed alert's metrics page to filter table only on the alert - Added all authentication modes (Azure AD, etc.) in Total Logins KPI in overview ### Data Processing Engine - Improved stability and performance of the execution of jobs - Increased default limit of maximum jobs that can be launched at the same time to 42 - Jobs can no longer be put to the queue, an error will be returned if the maximum limit is reached - Added new "Automatic segmentation" mode ### Data Manager - On a Kafka source, added possibility to choose between watching from the earliest or the latest offset for each topic - Fixed error in chart in Overview page when storage engine is missing - Moved toggle near to text in wide screen when configuring sources - Added message if trying to analyze table of source in Analyzer but no tables in source ### Analytics Manager - Fixed list of attributes in table details - Removed counting Explorer queries in some charts and KPIs in overview ### Machine Learning Manager - Fixed display success rate heatmap in metrics notebook and pipeline - Fixed adding modules in notebook by type of notebooks (PySpark vs Python) --- ## Week 39 **Date:** 03/10/2022 ### Control Center - Fixed organization-level view not available despite being authenticated in IAM --- ## Week 38 **Date:** 22/09/2022 ### Identity Access Manager - Introducing new [CEL role conditions](/en/product/iam/users/roles)! Use the new visual condition builder to give fine-grained permissions on resources, or write your role conditions using Common Expression Language (CEL) - Currently, CEL conditions are only available for roles containing permissions on IAM service solely. ### Control Center - Automatically add author of the alert to the subscribers - Added alert categories - Added alert status next to the title in UI ### Data Processing Engine - Removed segmentation options not available depending on the connector type - Improved job execution time by improving the build system ### Data Manager - Added historical values of storage size in Overview - Improved job execution time by improving the build system --- ## Week 37 **Date:** 15/09/2022 ### Control Center - We revamped the log exploration interface! Now, you can scroll down to progressively load logs as they go - Added two new alert consumers: Amazon SNS and Opsgenie - Updated email text content ### Data Processing Engine - Multiple bug fixes and performance improvements ### Data Manager - Warning: `/metas` API endpoint is now deprecated. Please make sure to stop using it when calling your ForePaaS Dataplants from outside. - Multiple bug fixes and performance improvements --- ## Week 36 **Date:** 08/09/2022 ### Control Center - Fixed external consumers unexpected coercion on configuration field - Fixed slack config (remove not working fields Channel, username, user icon) ### Data Processing Engine - Stability and performances improvements - UI changes to environments to force user to click on confirm before saving ### Data Manager - Stability and performances improvements ### Analytics Manager - Fixed autosave right after opening a query ### Identity Access Manager - Several interface bug fixes and improvements - Prevented access to service interface from header and url if no rights - Updated title and message in authentication page for Dataplant application - Added default message in authentication page when creating new application --- ## Week 35 **Date:** 01/09/2022 ### Platform - Updated title in tabs of browser when being on the Overview page of a component ### Control Center - We added tooltips on each KPI on the overview! Learn how a specific metric was obtained by hovering over it for a couple of seconds. - Overview: Added ability to filter panel Consumption by providers or dataplants - Fixed chart consumption in organization level that wouldn't stack - Fixed jobs heatmap in overview when filtering by timeframe, and to only display only CRON-based - Updated Y-axis for cpu / ram charts to adjust to the value - Optimized display of items for DPE and ML dashboards ### Data Manager - Added shortcut file upload when create new source from overview - Updated selectbox style in Explorer ### Data Processing Engine - Disabled create action button on the onboarding welcome page if no rights ### Analytics Manager - Updated selectbox style in queries - Added origin explorer in filter of history - Fixed fields not showing all attributes in visual builder when adding first filter ### Identity Access Manager - Added button to copy application’s url to clipboard --- ## Week 34 **Date:** 25/08/2022 ### Control Center - The Control Center is now in Beta release! - Fixed display of days in the date picker - Metric "Login per hour" is now "Total logins", and metric "RPS" is now "Current RPS" ### Data Processing Engine - Fixed behavior of [environment variables](/en/product/dpe/actions/settings/index?id=environment-variables) ### Data Manager - The "Directly Queryable" feature has been renamed to [Direct Query](/en/product/connectors/sources/index?id=make-your-data-source-directly-queryable). Use the Analytics Manager to run queries on remote sources without having to import the data! - Added endpoint *health* ### Identity Access Manager - Fixed sessionExpired when calling IAM after login with APIkey/secret key --- ## Week 33 **Date:** 18/08/2022 ### Control Center - Fixed scroll bar in alert editor, monitoring and job’s triggers pages. - Number of failed execution now includes timed out executions. - Added full time in tooltip of network charts. ### Data Processing Engine - Added retry when retrieving DPE action/workflow configuration. --- ## Week 32 **Date:** 11/08/2022 ### Platform - Fixed size tooltip in charts. ### Control Center - Fixed overview chart storage when organisation view. - Improved chart consumption in overview. - Forced display tooltip for charts event if no value. - Updated tracker front. - Fixed logout. - Updated auto generate name for new alert. - Fixed update FPU for items from old infra monitoring. ### Data Manager - Fixed delete file when buckets not loaded. ### Machine Learning Manager - Allowed adding link for notebook dependencies. ### Identity Access Manager - Added permission DM for DM & QB Editor. - Added role Control Center Editor. - Created Infrastructure Managers group. - Updated name of Identity Access Managers group. --- ## Week 31 **Date:** 04/08/2022 ### Control Center - Prevented second click when create alert + Autogeneration of name. - Removed info from selectbox to select existing consumer + prevented adding it if required field is not filled. - Showed preview of instances when toggle HA in storage engine dashboard. - Added tracking UI. - Refreshed time when click on refresh button in logs explorer. - Jobs: Fixed long loader. - Jobs: Added missing filter "Execution method". - Jobs: Added more options for filter "Status". - Jobs: Fixed failed case in graphs. - Jobs: Added hyperlink for Object name of job. - Jobs: Fixed wrong icon. - Jobs: Fixed duplicate objects in table. - Jobs: Fixed numbers of executions column. - Jobs: Fixed edit ml trigger. - Logs: Fixed wrong icon. - Logs: Sorted the list of object by numbers of executions - Logs: Fixed toggle streaming button - Logs: Added show numbers of search result - Logs: Fixed filter cleared after refreshing logs - Logs: Sorted and filter execution_id in the filter options ### Data Manager - Fixed related items in attributes pages ### Machine Learning Manager - Update select box for depencies if pyspark notebook. - Update icon when notebook starting or stopping. ### Data Processing Engine - Removed stopped deployments from active deployments table. --- ## Week 30 **Date:** 28/07/2022 ### Control Center - Removed not necessary actions in top of treeview in alerts. - Optimized call in dashboarding default (call was send on all data plant instead of one). - Added style to redirect on name in table (like in DPE). - Added name of dataplant in tooltip of charts. - Displayed first row of charts in one third for panel in overview. - Updated chart of alerts active over time (fix xAxis and add 0 in green). - Removed warning when edit fpu from API / APP / AM dashboarding. - Fixed alignment in input-fpu. ### Data Processing Engine - Fixed size and add tooltip on tags in treeview. ### Query Builder - Fixed size and add tooltip on tags in treeview. ### Machine Learning Manager - Fixed size and add tooltip on tags in treeview. --- ## Week 29 **Date:** 21/07/2022 ### Control Center - Update title in tabs browser - Add some tooltips - Update xAxis on charts - Overview: Update current alert triggerings table - Overview: Fix xaxis for active alert over time chart - Monitoring: Fix chart network not reloaded when update datepicker - Monitoring: Fix redirect to item when click on name from table - Monitoring: Fix update FPU of item - Monitoring: Add search by tags in tree view - Monitoring: Fix UI in storage engine dashboard - Alerts: Add "Only watch CRON-triggered" feature - Alerts: Fixed target saving conditionals - Alerts: Added a Metrics shortcut from the treeview - Alerts: Fixed alert duplicate - Alerts: Added alert status in alert title - Alerts: Health check ability to select all resources - Alerts: Trigger - Default value by default - Alerts: Subscribers pagination fix - Alerts: Ability to search for subscribers from the added list - Settings: Ability to edit an external consumer ### Analytics Manager - Fixed scroll in query fields when vertical view ### Data Manager - Fixed scroll in query fields when vertical view --- ## Week 28 **Date:** 13/07/2022 ### Control Center - The [Control Center](/en/product/cc/index) is now available in Alpha release! Get full observability on each service and component in your data project. - Monitor metrics across your data pipelines, applications, and deployed instances - Drill-down on logs to troubleshoot errors - Set up alerts when issues arise - Ensure scalability by adding more resources on any service as needed ### Identity Access Manager - Bug fixes and improvements to session management --- ## Week 27 **Date:** 07/07/2022 ### Platform - Updated CSV file connector. ### Data Processing Engine - Enabled concurrent execution button for serverless environments. --- ## Week 26 **Date:** 30/06/2022 ### Platform - Support of multi factor authentication (MFA). ### Data Manager - Connectors (Druid, OpenSearch, Prometheus) - New Explorer tab released in Alpha. - Optimized query execution to be able to use virtual attributes in SQL mode ### Data Processing Engine - Point-and-click PySpark Load and Aggregate actions are now available in Alpha release - Optimized provisioning time with ForePaaS actions. - Multiple concurrent executions in Serverless mode. --- ## Week 25 **Date:** 23/06/2022 ### Platform - Fixed version api on serviceaccounts that can be on error while sent to kubernetes. ### Data Processing Engine - Disabled concurrent execution button for serverless environment. - Uniformized Information panel when editing an element. --- ## Week 24 **Date:** 16/06/2022 ### Platform - Updated Japanese translations. ### Machine Learning Manager - Update open Notebook CTA. --- ## Week 23 **Date:** 09/06/2022 ### Platform - Bug fixing and improvements. --- ## Week 22 **Date:** 02/06/2022 ### Platform - Fixed Japanese some translations. - Updated list of restricted words for tables/attributes names. - Bug fixing and improvements. --- ## Week 21 **Date:** 26/05/2022 ### Platform - Bug fixing and improvements. --- ## Week 20 **Date:** 19/05/2022 ### Platform - Removed big shadow on white buttons. - Improved tooltip display. ### Data Processing Engine - Fixed folder on some treeviews. - Added advised bucket size. ### Data Manager - API: created a v4/metrics endpoint to aggregate metrics from DM, storage volume. - Hotfixed metrics endpoint. - API metrics extract: added possibility to update table parameters depending of connector func --- ## Week 19 **Date:** 12/05/2022 ### Data Processing Engine - Actions treeview bug fixed. - Actions folder treeview bug fixed. --- ## Week 18 **Date:** 05/05/2022 ### App Manager - Fixed copy and remove with new Minio gateway. ### Identity Access Manager - Fixed populate of undefined when getRolesAcls for users. - Fixed generate password too long. - Update format date generated password ### Data Processing Engine - Introducing [Always-up execution mode](/en/product/dpe/actions/settings/index?id=execution-modes)! 🎉 Execute your jobs faster with the new Always-up execution mode in Data Processing Engine - In addition to the standard *Serverless* execution mode, now you can also keep dedicated resources always up and ready to run your jobs instantly. - Added placeholder for empty table in metrics. ### Machine Learning Manager - Added placeholder for empty table in metrics. ### Analytics Manager *This component is currently released under open beta.* - Added limit in query configuration. - Put select be default when select data. - Added a shortcut to preview a table directly from a table. --- ## Week 17 **Date:** 29/04/2022 ### Platform - Added link to have info on OVH acquisition in no new account page. - Added modal confirm when delete member from editor. - Added status of job in job detail. - Fixed condition to display provider logo in dataplant block. - Added link to documentation on how to manage members in request to join organisation email. ### Data Manager - Added column in sources. - Added tooltip for generate action in table list. ### Data Processing Engine and Machine Learning Manager - Fixed message in FPU settings for environment. --- ## Week 16 **Date:** 22/04/2022 ### Data Manager - Removed virtual attributes from Tables page - Added info on system bucket - Fixed bug to attach sandbox in DM + can unlink sandbox ### Analytics Manager *This component is currently released under open beta.* - Display more attributes in selectbox data and scale - Updated function to set sum or select by default - Added placeholder in filters - Hiden ML tables in table details in query editor - Added shift + Enter to run query And wait after saving to run it - Added loader when run from SQL editor from keyboard - Added download as a json - Fixed size of SQL in history table - Fixed switch in filter from between to in - Added created_at and updated_at column in queries list ### Data Processing Engine - Ability to view workflow from action lineage page - Bug fixed: workflows list of actions was wrong when using repo versioning ### Identity Access Manager - Updated icon in active users table. - Formated the result of cron with UTC ### Platform - Added option to resize columns in many tables - Fixed active lang in header. --- ## Week 15 **Date:** 14/04/2022 ### Data Manager - Fixed edition of attribute name after creating it. ### Analytics Manager *This component is currently released under open beta.* - You can now run query by pressing cmd/ctrl + Enter in SQL mode. ### Data Processing Engine - Fixed display error when start action/workflow. ### Machine Learning Manager - You can now export your notebooks as DPE Custom Actions, MLM Estimators or MLM Scoring Functions. ### Identity Access Manager - Fixed generate pwd when the username is empty. ### Platform - New header. --- ## Week 14 **Date:** 07/04/2022 ### Data Manager - You can now activate *Directly Queryable* mode for supported sources: run SQL queries from the Analytics Manager on those sources without having to load their data into ForePaaS. ### Analytics Manager *This component is currently released under open beta.* - Added free-trial paywall for resources. ### Data Processing Engine - Fixed display error when start action/workflow. - Added max length to filenames. ### Platform - Added in trial paywall when trying to update FPU in monitoring when free-trial mode. --- ## Week 13 **Date:** 29/03/2022 and 31/03/2022 ### Platform * Updated the home page of Dataplants: the Data Processing Engine is now located below the Data Manager instead of being to its left. * Added new cookies management solution ### Data Manager - Added a shortcut to create or upload a source. - Updated style of storage engine status. - Fixed long naming when table is created by drag and drop. - Improved handling of small error from sentry report. ### Data Processing Engine - Added a shortcut to create or upload a custom action. - Updated the maximum value of the FPU slider for actions and workflows. ### Machine Learning Manager - Updated the maximum value of the FPU slider for pipeline steps. ### Identity Access Manager - Fixed the positions of the permissions modal filter --- ## Week 12 **Date:** 25/03/2022 ### Platform * FP Store * Added Japanese translations * Fixed search ### Analytics Manager *This component is currently available under open beta release.* * Fixed reactivity when activating Trino. * Added API endpoints for exporting and importing AM configuration. * Bug about updating chart configuration in Query fixed. ### Data Manager * Fixed reactivity when changing default storage engine. * Updated Clickhouse connector. * Renamed MemSQL to Singlestore. ### App Manager * Removed Owned and Not owned from categories