Product updates

From September 30, our extraction system for FTP and SFTP sources will be updated to ensure better consistency between your published datasets and their original source.🔎 What’s changingCurrently, extracted files are cached even if they are deleted from the source. With the new process, only files that are present in your external source at the time of republishing will be kept. Deleted files will no longer be retained in Opendatasoft.👉 Actions to take before September 30If there are deleted files still stored in your cache, you can:Keep them by adding them back to your source, or by exporting your current dataset and reintegrating it into the source. Permanently delete them by clearing the cache for the relevant datasets, starting from a clean slate.         🚀 Benefits of this updateFaster and smoother loading in the back office Data is always aligned with your external source Improved traceability of extraction errors💡 Need help?Contact your Customer Success Manager, our Support team. 

The form feature keeps evolving to offer you more flexibility and improve the quality of collected data:           👉 Learn moreHaven’t created a form yet? A free form is still included by default. Just ensure the “forms” permission is enabled in your back office to access the feature. 🙌 

The previous limit of 100,000 records is gone!Enrich your data now using large datasets with large reference datasets such as France’s SIRENE (a directory of ID codes for every business in the country)— without compromising performance!        👉 To try out the new processor, check the user documentation.👉 To understand potential impacts, watch this video.

Multi-factor authentication is now available and complements existing security mechanisms to enhance the protection of your portal!          👉 Enable MFA now

In a few days, you'll be able to perform joins on very large datasets with no size limit. 🎉     👉 To help you prepare for this change, you’ll receive an email with the list of affected datasets and the actions to take. Stay tuned!

Looking for an easy way to collect data and re-engage with your data consumers? 🤝 With our new feature, create and customize forms in just a few clicks!             A free form to let you start testing right away 🙌Go to your back office (ensure you have the "Forms" permission enabled to access it)Go to the tab "Forms" (the free form allows up to 50 submissions)Start building your form (If you want to build more forms, contact your Sales representative)📕 Check out our user documentation to deep dive into the feature. Key benefits of Opendatasoft's forms 😎Seamless integration to your data: Over 16 field types available to collect responses (SIRET, image, location, keywords…). Assisted form completion: Advanced auto-completion to save time for your users (automatic filling of user profile information, selection of answers based on dataset records from your portal…). Flexible sharing options: Share forms via QR code or link, with customizable access options (public, restricted, or specific). Instant value creation: Easily turn your contributions into datasets and data visualizations.

This connector allows you to retrieve pedestrian and cyclist counting data from the Eco-Visio platform, with more than 20,000 counters installed in 50 countries. 🌎 🚀 New updateThe connector has been updated to use Eco-Counter’s API v2. Until now, the connector relied on API v1, which will be deprecated by the end of the year. We have also added a new filtering parameter, allowing you to retrieve only the data from the counting sites you need—without having to import everything!👉 Useful informationMandatory migration: Existing connectors must be recreated as a new API key (v2) is required and must be generated from the Eco-Counter platform. Transition phase: Old connectors will remain temporarily functional on your portal, but we strongly recommend starting the migration now to ensure service continuity.Learn moreCheck out our user documentation or join the community to share your feedback and questions. 🙌

The design of the processor management interface in the back office has been revamped for a smoother, more modern user experience:Something new is coming… 🚀This new interface will soon host a major advancement on the platform: the ability to perform joins on large data volumes. No more limits of 100,000 records—soon you'll be able to enrich your datasets with large datasets, without restrictions (like with the SIRENE database with its millions of records). Stay tuned, it's coming soon!

Not all fields in your datasets are equally important, and you are the best person to guide your end users in their searches. A quick and intuitive solution for more relevant and efficient searches With the new feature, optimize search results by simply adjusting the weight of each field. Assign a relevance coefficient to each field (default set to 1) or exclude fields from search results if needed. Key benefits of this update Intuitive user experience: Adjust coefficients in just a few clicks through a seamless interface and get a comprehensive view of all coefficients applied to a dataset. Centralized configuration: Manage and review all field coefficients from one place in the “Visualizations > Settings” tab. Optimized and more relevant searches: Completely exclude certain fields from the search to focus only on those that are truly relevant to your datasets. Try the feature now!Go to your back office Select a dataset Navigate to the “Settings > Visualizations” tab In the “Record text search” section: Option 1: Choose “Highlight” to adjust a field’s coefficient and influence its weight in searches Option 2: Choose “Ignore” to exclude a field from text searches. Learn moreCheck out our user documentation or share your feedback and questions on Community to help other members of the community. 

No more endless scrolling to move a field when managing your dataset schema! With the new interfaces and a dedicated tab, everything becomes simpler and faster.  Schema define the structure of your datasets and we’ve completely redesigned how you manage them for a smoother and more intuitive experience.Discover the updates included in this release. 👇 A new tab dedicated to schema managementUntil now, schema management was accessed via the "Processing" tab of your back office. Moving forward, it has its own dedicated space in the new "Schema" tab.     An optimized visualization and editing experienceIntuitive drag-and-drop management to instantly organize your fields. Seamless navigation, perfect for effortlessly browsing through columns. Simplified editing through a separate side panel.   Faster and more flexible schema management performanceWith schema management now in a dedicated tab, schema changes are now applied instantly, independent of the processing preview's calculation time—a significant improvement when handling large datasets. Updates to the “Processing” and “Visualization” tabs“Processing” tab: This tab now focuses exclusively on processing actions, including adding processors. While field configuration has been moved to the dedicated schema tab, you can still configure fields directly from this space using a convenient shortcut designed to save you time. “Visualization” tab: This tab, dedicated to customizing the front-office views of your portal, now features a “Settings” sub-tab. Here, you'll find all the options for configuring the fields visible to your end users, such as: Record filters, which can now be sorted independently of the field order defined in the schema. Filters on records. New: filters can now be ordered independently of the field order defined in the schema (⏳ this feature is still in beta and may not yet work across all your datasets). Column displays adapted to your portal's language.  Learn more Read more in the User Documentation: Defining a dataset schema Configuring filters and visible fields Refining your data through processing Share your questions on Community Contact our Support Team Auto-translation 🪄Fini le scrolling interminable pour déplacer un champ lors de la gestion du schéma de votre jeu de données ! Avec les nouvelles interfaces et un onglet dédié, tout devient plus simple et plus rapide. Les schémas définissent la structure de vos jeux de données et nous avons entièrement repensé la façon dont vous les gérez pour une expérience plus fluide et plus intuitive. Découvrez les mises à jour incluses dans cette version. 👇 Un nouvel onglet dédié à la gestion des schémasJusqu'à présent, la gestion des schémas était accessible via l'onglet "Traitement" de votre back-office. Désormais, elle dispose de son propre espace dédié dans le nouvel onglet "Schéma".      Une expérience de visualisation et d'édition optimiséeUne gestion intuitive par glisser-déposer pour organiser instantanément vos champs. Une navigation fluide, parfaite pour parcourir sans effort les colonnes. Une édition simplifiée via un panneau latéral séparé. Des performances de gestion des schémas plus rapides et plus flexiblesAvec la gestion des schémas désormais dans un onglet dédié, les modifications de schéma sont désormais appliquées instantanément, indépendamment du calcul de l'aperçu du traitement

The account management, login, and registration interfaces on your portal have been redesigned to enhance the user experience and will soon be available. Get a sneak peek at the improvements introduced in this update through this article, featuring short explanatory videos to help you visualize the changes. 📽 ⏳ Upcoming Changes Managing your Opendatasoft AccountThe creation and management of Opendatasoft accounts will now be handled through a new external application, accessible at the following address:👉 https://account.opendatasoft.comThis centralized application will allow you to manage your personal information (username, name, email, password, etc.).Additionally, the "Account" section of your portal has been updated to reflect this change:A direct link to the application will be available. Other portal-related information, such as API keys, quotas, or notifications, will remain accessible as before.Good news: your credentials remain unchanged, and all your existing configurations (account settings, notifications, permissions, API keys, etc.) are preserved. There's no need to log out or log back in. For Portals Connected to a Corporate Directory (SSO)If you have enabled an SSO directory for your portal, please note that:All your existing configurations are preserved. SSO management has been migrated to a dedicated page in the "Access" section of the back office for more intuitive management.  The SSO login buttons are now more visible and highlighted in the login window. Their labels remain fully customizable, as before, to meet your specific needs.  Login and Registration to a PortalThe interfaces are evolving to simplify the management of logins and registrations, providing an optimized experience for both the back office and the front office. SettingsThe dedicated registration page is evolving to become "Login and Registration," still within the "Access" section of the back office. You will find all configurations related to these two features there, for simpler and more centralized management. Interface UpdatesThe login and registration interfaces have been redesigned to offer:A more modern and intuitive design, aligned with current standards. The ability to log in directly to your portal through the new Opendatasoft account management application. Focus on the “Registration” Section👉 Separation Between Account Creation and Portal RegistrationCreating an Opendatasoft account and registering for a portal are now two distinct steps, carried out in an intuitive sequence:Account Creation or Login: The user will be prompted to either create an Opendatasoft account or log in with an existing one. Portal Registration: Once logged in, they can register for the specific portal👉 Customized Management of the Registration FormYou have the option to disable the registration form if you do not wish to collect specific messages or consents. In this case, the user will only need an Opendatasoft account to register for the portal. If access request approval is enabled, a request will be automatically sent, including information from the user’s Opendatasoft account, for validation.When the form is enabled (which will be the default), it can be customized to meet your needs. You will be able to:Modify the title and description Make message input mandatory Collect specific consent Invitation to a PortalThe interfaces for the invitation process are also evolving. While the steps remain the same as before, they now go through the new account management application. 🔎 New access rulesFor all portals (public and private): new users will need to follow two steps to authenticate:Create an Opendatasoft account (via the external application) Log in to the portalFor public portals only: users can access freely and anonymously without creating an account or registering. However, to save created content (maps, charts, etc.), they will need to:Authenticate with their Opendatasoft account (or create one) Register for the portal (or be invited, if the portal does not allow self-registration) 🚀 Benefits of These ChangesThese changes represent a significant step forward in enhancing your user experience and shaping the future of the platform:A simplified interface for each step (registration, login, account management) and unified access to all Opendatasoft tools (Community, Academy (coming soon), portals). Strengthened security, with a solid foundation to soon integrate advanced features like multi-factor authentication. Improved personalization, thanks to an architecture designed to offer more flexibility in the future.Auto-translation 🪄Les interfaces de gestion de compte, de connexion et d'inscription de votre portail ont été repensées pour améliorer l'expérience utilisateur et seront bientôt disponibles. Découvrez en avant-première les améliorations apportées par cette mise à jour à travers cet article, accompagné de courtes vidéos explicatives pour vous aider à visualiser les changements. 📽 ⏳ Changements à venir Gestion de votre compte OpendatasoftLa création et la gestion des comptes Opendatasoft se feront désormais via une nouvelle application externe, accessible à l'adresse suivante :👉 https://account.opendatasoft.comCette application centralisée vous permettra de gérer vos informations personnelles (identifiant, nom, email, mot de passe, etc.).De plus, la section « Compte » de votre portail a été mise à jour pour refléter ce changement :Un lien direct vers l'application sera disponible. D'autres informations liées au portail, telles que les clés API, les quotas ou les notifications, resteront accessibles comme auparavant.Bonne nouvelle : vos identifiants restent inchangés, et tous vos identifiants existants

A few weeks ago, we announced the arrival of a new AI-powered feature in the solution, allowing you to generate data visualizations simply by querying a dataset in natural language.But did you know that it's possible to generate three types of visualizations? 👇 Maps…             Charts…          … and figures        Activation requiredTo activate this feature, simply contact your Customer Success Manager, your sales representative, or Opendatasoft support, and make the most of it for free until the end of the year. To learn moreCheck out the dedicated documentation Test the feature on our Data Hub by accessing a dataset and clicking the “Explore Data with AI” button, located at the top right. Auto-translation 🪄Il y a quelques semaines, nous vous annoncions l'arrivée d'une nouvelle fonctionnalité propulsée par l'IA dans la solution, permettant de générer des visualisations de données simplement en interrogeant un jeu de données en langage naturel. Mais saviez-vous qu'il était possible de générer trois types de visualisations ? 👇 Des cartes…             Des graphiques…           … et des chiffres        Activation requisePour activer cette fonctionnalité, il vous suffit de contacter votre Customer Success Manager, votre commercial ou le support Opendatasoft, et d'en profiter gratuitement jusqu'à la fin de l'année.  Pour en savoir plusConsultez la documentation dédiée Testez la fonctionnalité sur notre Data Hub en accédant à un jeu de données et en cliquant sur le bouton « Explorer les données avec l'IA », situé en haut à droite. 

What if your users had a data visualization expert by their side, ready to help them quickly create their maps and charts? 👀That’s what our new feature provides, meaning generating data visualizations has never been easier. Users just ask a question, and the AI handles the rest!Available to all users registered on your portal, "Explore Data with AI" provides an interactive tool to easily explore, transform, and reuse raw data independently.Revolutionize the way your users explore your datasets, delivering multiple benefitsRange of available visualizations: Create a variety of formats, including maps, charts, and graphs, all tailored to the user’s specific request. Multiple export formats: Easily reuse visualizations through export formats such as PNG, CSV, and API Explore requests. Expand your audience: Once activated, the feature is available to all registered users on your portal, encouraging new users to sign up. Train on AI: Help your users understand and master AI-powered features, with the tool providing clear explanations for each visualization, backed up with dedicated documentationActivation requiredTo activate this feature, simply contact your Customer Success Manager, your sales representative, or Opendatasoft support, and make the most of it for free until the end of the year.To learn moreCheck out the dedicated documentation Test the feature on our Data Hub, or on one of our customer portals by accessing a dataset and clicking the “Explore Data with AI” button, located at the top right.Auto-translation 🪄Et si vos utilisateurs avaient un expert en visualisation de données à leurs côtés, prêt à les aider à créer rapidement leurs cartes et graphiques ? 👀C'est ce que propose notre nouvelle fonctionnalité, ce qui signifie que générer des visualisations de données n'a jamais été aussi simple. Les utilisateurs posent simplement une question, et l'IA s'occupe du reste ! Disponible pour tous les utilisateurs enregistrés sur votre portail, « Explore Data with AI » fournit un outil interactif pour explorer, transformer et réutiliser facilement les données brutes de manière indépendante. Révolutionnez la façon dont vos utilisateurs explorent vos ensembles de données, offrant de multiples avantages Gamme de visualisations disponibles : créez une variété de formats, y compris des cartes, des diagrammes et des graphiques, tous adaptés à la demande spécifique de l'utilisateur. Plusieurs formats d'exportation : réutilisez facilement les visualisations via des formats d'exportation tels que PNG, CSV et les requêtes API Explore. Élargissez votre audience : une fois activée, la fonctionnalité est disponible pour tous les utilisateurs enregistrés sur votre portail, ce qui encourage les nouveaux utilisateurs à s'inscrire. Formez-vous à l'IA : aidez vos utilisateurs à comprendre et à maîtriser l'IA

What is a geographical referential?A geographical referential is a dataset providing spatial information, such as the administrative divisions of a country or territory.What are the new referentials available?New geographical referentials are now available for France, Germany, Belgium, the United States, and the United Kingdom. Where can I access these new referentials?You can find them in three different places:1. On the Data Hub:Referentials for France (2024 data). 👉 IRIS data is not included due to its unavailability at the time of the update Referential for Germany (2023 data) Referential for Belgium (2023 data) Referential for the United States (2023 data) Referential for the United Kingdom (2022 data)2. In the geographical processors section of the solution: “Geojoin” Processor: which allows you to retrieve the shape and center of administrative divisions (check out the documentation for more information) “Retrieve Administrative Divisions” Processor: which allows you to retrieve the shape, INSEE code, and name of administrative divisions (check out the documentation for more information) 3. In the Studio base maps of the solution: ⏳ More updates coming soonOur teams are actively working to continuously update geographical referentials. Stay tuned for upcoming announcements.Auto-translation 🪄Qu'est-ce qu'un référentiel géographique ? Un référentiel géographique est un jeu de données fournissant des informations spatiales, comme les découpages administratifs d'un pays ou d'un territoire. Quels sont les nouveaux référentiels disponibles ? De nouveaux référentiels géographiques sont désormais disponibles pour la France, l'Allemagne, la Belgique, les États-Unis et le Royaume-Uni. Où puis-je accéder à ces nouveaux référentiels ? Vous pouvez les trouver à trois endroits différents : 1. Sur le Data Hub : Référentiels pour la France (données 2024). 👉 Les données IRIS ne sont pas incluses en raison de leur indisponibilité au moment de la mise à jour) Référentiel pour l'Allemagne (données 2023) Référentiel pour la Belgique (données 2023) Référentiel pour les États-Unis (données 2023) Référentiel pour le Royaume-Uni (données 2022) 2. Dans la section des processeurs géographiques de la solution : Processeur « Geojoin » : qui permet de récupérer la forme et le centre des découpages administratifs (consultez la documentation pour plus d'informations) Processeur « Récupérer les découpages administratifs » : qui permet de

 As of June 9, 2024, an EU directive requires public bodies to make freely accessible certain high-value datasets (HVD) in six categories: geospatial, environmental, meteorological, statistical, business, and mobility.🚀 To help you ensure your datasets comply with the directive, a new metadata template “DCAT-AP-High Value Datasets (HVD)” has been added to the platform. This template is an extension of the DCAT and DCAT-AP templates, allowing you to expose HVD metadata on national portals that reference your datasets.👉 To activate the new DCAT-AP-HVD metadata template and start entering new metadata:Go to your back office In the "Catalog" menu Click on "Metadata templates" Click on the "Interoperability" tab Activate the "DCAT-AP High Value Datasets (HVD)" template Access an existing dataset or create a new one In the "Information" tab of your dataset, begin filling out the metadata for this new template👉 To export your catalog with DCAT-AP-HVD metadata:Once completed, DCAT-AP-HVD metadata is available in the DCAT-AP-XXX (where XXX is a country) and DCAT catalog exports. To export your catalog with DCAT-AP-HVD metadata:Activate the DCAT-AP-HVD metadata template and fill out this metadata for specific datasets (following the steps above) Activate either the DCAT metadata template or the DCAT-AP-XXX template for your chosen country. If you choose the DCAT-AP-XXX model you will need to contact support to activate the corresponding export Export your catalog in the DCAT or DCAT-AP-XXX format. You will then find the HVD metadata you have filled out!Auto-translation 🪄Depuis le 9 juin 2024, une directive de l'UE impose aux organismes publics de rendre librement accessibles certains ensembles de données à haute valeur ajoutée (HVD) dans six catégories : géospatiales, environnementales, météorologiques, statistiques, commerciales et de mobilité.🚀 Pour vous aider à garantir la conformité de vos ensembles de données à la directive, un nouveau modèle de métadonnées « DCAT-AP-High Value Datasets (HVD) » a été ajouté à la plateforme. Ce modèle est une extension des modèles DCAT et DCAT-AP, vous permettant d'exposer les métadonnées HVD sur les portails nationaux qui référencent vos jeux de données.👉 Pour activer le nouveau modèle de métadonnées DCAT-AP-HVD et commencer à saisir de nouvelles métadonnées :Accédez à votre back-office Dans le menu « Catalogue » Cliquez sur « Modèles de métadonnées » Cliquez sur l'onglet « Interopérabilité » Activez le modèle « DCAT-AP High Value Datasets (HVD) » Accédez à un jeu de données existant ou créez-en un nouveau Dans l'onglet « Informations » de votre jeu de données, commencez à remplir les métadonnées de ce nouveau modèle👉 Pour exporter votre catalogue avec les métadonnées DCAT-AP-HVD :Une fois terminé, DCAT-AP-HVD

We have added two configuration options in the "datasets of datasets" to help you better manage your portal and improve its quality:         Option "Harvesters information": Easily identify the source you are harvesting datasets from, by viewing the following three columns: "Harvester UID," "Harvester Name," and "Harvester Type" (click here to learn more about harvesters 💡). Option "Processing status": Spot which datasets are being published and which have errors through the "Processing status" column.👉 To start exploring these new options:Go to your back office Click on "New dataset" In the "Configure a remote service" category, click on "Dataset of datasets" In the "Configuration" tab, check the "Harvesters information" and/or "Processing status" options Publish your dataset Click on "Explore" and quickly discover the new information that helps you improve the quality of your portal.

Unclear queries, spelling mistakes, unfamiliar portal-specific jargon: Don't let your users miss out on finding relevant data anymore, thanks to our new AI-powered search engine that goes beyond keyword matches.         👉 Learn more

Following the recent integration of the field-level view, allowing for a more detailed analysis of dependencies and errors between objects, the data lineage feature is now enriched with new information: the source of your datasets.     Comprehensive view of your data's journeyVisualizing the source of your datasets in lineage provides a deeper understanding of their journey, simplifying verifications.To start exploring:Go to your back office Select any dataset Click on the "Lineage" tab Discover the source of your dataset 

It's coming soon! Our teams have been working for several months on a new AI-powered semantic search engine (already tested and adopted by a few beta testers 🙌) aimed at enhancing the user experience on your portal. This innovative feature will enrich data discovery and help users find what they are looking for more easily.Here's some information before the official release. 👇  Why is this innovation important?Search is the central element of a successful data portal experience. Given the diversity of datasets and the specific terminology used to describe them, it is crucial to optimize search performance and improve the relevance of results to increase usage. Our semantic search allows users to quickly and intuitively find what they are looking for by expanding search beyond literal matches, providing results based on intent and the contextual meaning of search terms.Why does the new engine rely on AI?Our semantic search relies on AI to enhance its ability to understand the meaning and context of queries, broadening the scope of relevant results. By considering factors such as spelling mistakes, synonyms, and the contents of metadata, it will provide users with a more comprehensive, guided, and effective search experience.How can I deploy AI-powered search?We’ll update you by email and via the platform once the search engine is officially launched, explaining how you can integrate it into your portal. To learn moreCheck out our blog post on the subject or explore our Data Hub!

🔎 What is Parquet export?Parquet export is one of the fastest data storage formats to read and load. Its hybrid storage format (by column and by row) optimizes reading performance.  ✨ What are the advantages of the Parquet export format?Ultra-fast loading, ideal for large datasets Optimized storage, up to 7 times lighter than GeoJSON export Facilitated analysis, thanks to column organization Free and universal format, available in Open Source and compatible with a multitude of tools, including data science tools, Python, and the Opendatasoft Studio no-code via an extension.👉 Try out data export in the Parquet file format now!Head to your portal, or any Opendatasoft portal (including the Data Hub) Select a dataset Go to the “Export” tab Download the dataset in the Parquet format Start exploring the data  To learn moreDon't hesitate to read Opendatasoft or Parquet documentation.