Skip to main content

Gather data

Industrialize your data retrieval by connecting Opendatasoft to your business apps and storage resources.

  • 13 Topics
  • 36 Replies
13 Topics
Nicolas Terpolilli
Community Manager
Nicolas TerpolilliCommunity Manager
published in Gather data
Geographical referentials availability plan 2025News

A geographical referential is a dataset providing spatial information, such as the administrative divisions of a country or a territory.For a couple years now, we have invested in developing data pipelines in order to make those geographical referentials available in the product.They are available as simple datasets that you can use via federation for example. But they are also available in services: Processors (Geojoin and Retrieve Administrative Divisions) Studio base maps Providing those geographical referential is not an easy work. We rely on external sources. Even if they are official sources, they are sometimes not consistent in their release date. Also the API may change, the schema may change. It’s hard to keep up with the release even for us, so we know it’s even harder for you. Here is our plan in releasing geographical referential in 2025.We will try to keep it as up-to-date as possible. Though keep in mind that those dates are a best case scenario based on our experience fo

37714
Nadia VBX
Y
yvonneBeginner
asked in Gather data
Get ODS to take at least the first value (lat/lon)

I’m trying to use some Openstreetmap data in ODS.However some of the data is formed where there are multiple lat/lon for an ID and when bringing it into ODS, ODS takes none of the lat/lon pairs when there are multiple.  See screenshot of the multiple lat/lon pairs The records with multiple happen to be at the bottom as I think (assume) ODS uses the first 20 rows to determine a pattern.  I want ODS to at least take the first pair of lat/lon so the data is somewhat accurate (at the moment it just ignores this and leaves the lat and lon fields blank. Query used for bringing in the data is here:https://overpass-api.de/api/interpreter?data=%2F*%0AThis%20query%20looks%20for%20nodes%2C%20ways%20and%20relations%20%0Awith%20the%20given%20key%2Fvalue%20combination.%0AChoose%20your%20region%20and%20hit%20the%20Run%20button%20above%21%0A*%2F%0A%5Bout%3Ajson%5D%5Btimeout%3A25%5D%3B%0A%2F%2F%20gather%20results%0Anwr%5B%22highway%22%3D%22elevator%22%5D%28-27.870644599673355%2C152.0219421386719%2C-26.

111
Y
E
Eric MeyerBeginner
asked in Gather data
Use of [totals] in ods-adv-table widget

Hello!I am currently working on visualizing a table in a dashboard, and I would like to have a final row where I can freely sum or average the values in the table. The table is updated daily and evolves over time. The [totals] argument in ods-adv-table exists, but as far as I know, it only allows summing the column values.The only workaround we have found so far is to create a second table, removing the "group-by" per day and computing the sum/average where needed. However, this solution has a visual drawback: the legend remains, and the data in the second table is not perfectly aligned with the first one.Do you have any other ideas to improve the visualization? I would greatly appreciate your help :) 

482
A
danny.oneill
danny.oneillBeginner
asked in Gather data
Possible to proper case text?

Hi folks.Is there a way to proper case text with a processor i.e change biomass to Biomass?Sometimes our source is a little sloppy in their data management and I would like to correct it on publish. Thanks,

191
R
danny.oneill
danny.oneillBeginner
asked in Gather data
Help with JSON API source

Hi, Im really struggling to get the JSON processor to work with https://api.carbonintensity.org.uk/regionalI think I have it pulling in correctly but when I try and extract using the JSON processor using Extract from JSON or Expand JSON array it isnt populating the field. I’ve re-read the academy docs and asked ChatGPT but nothing is working in the output. Many Thanks,

192
danny.oneill
M
mranshu6290Beginner
asked in Gather data
Authentication and Limit of 100 objects

Dear TeamI hope this message finds you well.I am new here and currently working on using the sensor’s API. I have noticed that the results seem to be limited to what I see even if I am not authenticated. I am unsure if I am using the API authentication correctly.I have attached a screenshot of my current setup for your reference. Could you please guide me on the following:API Authentication: Am I using the correct authentication method? If not, could you please provide the correct steps 

471
Y
Community Manager
Nadia VBX
Nadia VBXBeginner
posted in Gather data
Limiter la connexion HTTP OAuth2 en App Registration à un site SharePoint en particulier

Après plusieurs tests de configuration, le support Opendatasoft nous a indiqué que le connecteur HTTP en OAuth2 ne permet pas encore de limiter l’autorisation d’accès à un site SharePoint en particulier “Sites.Selected” (voir Controlling app access on a specific SharePoint site collections - ESPC Conference, 2025). Pour le moment, il est uniquement possible d’accorder une autorisation sur tous les sites SharePoint de notre organisation ce qui n’est pas conforme aux bonnes pratiques de sécurité « least privilege access ».Nous espérons que ce développement sera programmé dès que possible par Opendatasoft. Nous vous remercions d’avance de soutenir ce besoin et de partager votre expérience à ce sujet.Nadia (Ville de Bruxelles)Auto-translation 🪄After several configuration tests, Opendatasoft support informed us that the HTTP connector in OAuth2 does not yet allow to limit the access authorization to a particular SharePoint site “Sites.Selected” (see Controlling app access on a specific Sha

250
Nadia VBX
Y
yvonneBeginner
asked in Gather data
API for dataset schema?

Hi Is there a way to update the (new) dataset schema via an API?https://userguide.opendatasoft.com/en/articles/2044866Auto-translation 🪄Hi Is there a way to update the (new) dataset schema via an API?https://userguide.opendatasoft.com/en/articles/2

422
Y
M
matthew.parryBeginner
asked in Gather data
Extract Geoshape from URL

I’m looking to load data from an API that has a value in each record that is a link to a json file that has geographical data in it. Is there a way to extract the data from each of those geojsons into their corresponding row on the Open Data Portal?Currently I am using the extract URL processor and the load file processor, but this only creates a hyperlink to the json file, rather than pulling the data out of those files as a geoshape.Is there a processor I can use to do this, or perhaps something I can do with the data source settings?Auto-translation 🪄Je cherche à charger des données à partir d'une API qui a une valeur dans chaque enregistrement qui est un lien vers un fichier json contenant des données géographiques. Existe-t-il un moyen d'extraire les données de chacun de ces geojsons dans leur ligne correspondante sur le portail de données ouvertes ? Actuellement, j'utilise le processeur d'extraction d'URL et le processeur de chargement de fichier, mais cela crée uniquement un li

331
Y
Community Manager
Y
yvonneBeginner
asked in Gather data
Main ODS data portal - download catalog

I’m having troubles opening the Excel version of the catalog downloaded from the main ODS Data portal:https://data.opendatasoft.com/explore/ (bottom left hand corner) The Excel version does not open.  The CSV version is messy Screenshot of CSV of catalog download Auto-translation 🪄J'ai des difficultés à ouvrir la version Excel du catalogue téléchargé à partir du portail principal de données ODS : https://data.opendatasoft.com/explore/ (coin inférieur gauche) La version Excel ne s'ouvre pas. La version CSV est désordonnée Capture d'écran du fichier CSV du téléchargement du catalogue

807
Y
Community Manager
Christian Trachsel
Christian TrachselBeginner
asked in Gather data
How long does a Sharepoint Data source works?

hifor how long it is possible to run the connector to a given Sharepoint file without interaction?regardsChristianAuto-translation 🪄Salut, combien de temps est-il possible d'exécuter le connecteur sur un fichier Sharepoint donné sans interaction ? Cordialement, Christian

533
A
ODS Team
Christian Trachsel
Christian TrachselBeginner
asked in Gather data
Normalize the webmercator projection

why is the way of displaying the different projections (north/east) in a geojson not used in the conversion?EPGSG: 3857Normalize Projection Reference processor - Opendatasoft : User guide and documentationAuto-translation 🪄pourquoi la manière d'afficher les différentes projections (nord/est) dans un geojson n'est-elle pas utilisée dans la conversion ?EPGSG : 3857Normalize Projection Reference processeur - Opendatasoft : Guide utilisateur et documentation

821
david.thoumas
ODS Team
V
ODS Team
Virtual UserODS Team
asked in Gather data
Old data is staying in the dataset when it’s not in my source files on my FTP, how is that ?

How does the FTP connector work behind the scenes?Auto-translation 🪄Comment le connecteur FTP fonctionne-t-il en coulisse ?

381
Rémy
Community Manager

Hello there!

Ask away and you shall receive an answer.
Terms & ConditionsCookie settings
Opendatasoft Terms & Conditions Cookie settings