Skip to main content

Organize data

Improve the quality of your data with our processors and enrich it with third-party data.

  • 17 Topics
  • 34 Replies
17 Topics
R
RyanMember
asked in Organize data
Editing geopoint schema

Hi,I understand that geopoint schemas cant be edited when they are the centre of a geoshape, but is there anyway to still be able to edit the description? Mainly to state that this point is in fact the centre of the shape and not a location point (see below) Thanks Ryan

50
R
Yanik Kipfer
Yanik KipferBeginner
asked in Organize data
Adding translations via Automation API

Is there a way to add metadata and dataset schema translations (e.g. in english or italian) via the Automation API?

421
L
ODS Team
Y
yvonneBeginner
asked in Organize data
Join datasets spatially

HiI’m trying to join a couple of datasets spatially.In Dataset A I have a geopoint (lat/long)In Dataset B I have a list of attributes in a polygon (shape) I want to use the geopoint in Dataset A as the key for Dataset B and return one or more columns from Dataset B…  Thank you for any options :)

321
M
luciaonmatteo
luciaonmatteoBeginner
asked in Organize data
How Can Hybrid Flash Storage Improve Data Processing in OpenDataSoft?

Hi everyone,I’m exploring ways to speed up data processing in OpenDataSoft and considering hybrid flash storage as a solution. Since hybrid flash combines SSD speed with HDD capacity, I’m curious how it performs in real-world OpenDataSoft applications.Some key questions:Does hybrid flash storage reduce query response times in OpenDataSoft? How does it handle high-volume data ingestion compared to traditional HDDs? Are there specific storage configurations that work best for OpenDataSoft datasets?I would love to hear your experiences and recommendations! Thanks. 

110
luciaonmatteo
luciaonmatteo
luciaonmatteoBeginner
asked in Organize data
Scaling Enterprise Server Performance with OpenDataSoft

Hey everyone,I'm currently using OpenDataSoft for managing large datasets, but I'm facing performance bottlenecks on my enterprise server when handling high data loads. I’d love to hear from others who have successfully optimized their setups.A few questions I have:What server configurations (CPU, RAM, storage) work best for large-scale data processing in OpenDataSoft? Are there caching techniques or database optimizations that improve query speeds? Any recommended load balancing strategies when dealing with heavy API requests? How do you handle real-time data ingestion efficiently?Looking forward to your insights! Thanks in advance.

180
luciaonmatteo
R
RenatoFBeginner
asked in Organize data
Retrieve column types through Automation API 1.0

Hi everyone,I'm working with the ODS Automation API (v1) and I'm trying to retrieve the data types of columns in a dataset. When using the `/datasets/{dataset_uid}/fields` endpoint, I receive a list of field configurations that includes annotations (facet, timerangeFilter, etc.) and rename operations, but I'm having trouble finding the actual data types of the columns (like text, date, integer).Here's an example of what I get from the endpoint (for fields related to the ‘end_date’ field, which is of type ‘date’):[{'annotation': 'facet', 'args': [], 'field': 'end_date', 'label': '', 'type': 'annotation', 'uid': 'pr_toc04f'}{'annotation': 'facetsort', 'args': ['alphanum'], 'field': 'end_date', 'label': '', 'type': 'annotate', 'uid': 'pr_adjonu'}{'annotation': 'timerangeFilter', 'args': [], 'field': 'end_date', 'label': '', 'type': 'annotate', 'uid': 'pr_yv06h9'}{'field_label': 'Enddatum', 'from_name': 'end_date', 'label': '', 'to_name': 'end_date', 'type': 'rename', 'uid': 'pr_xh8w8e'}]W

201
R
R
RyanMember
asked in Organize data
Multile filter selection on a multiple context dashboard

Hi All :)Ive been working on a dashboard based on the mutlple context code libary piece “https://codelibrary.opendatasoft.com/page-templates/dashboard-filter/#code-dashboard-with-filters-on-multiple-contexts-css-content” https://northernpowergrid.opendatasoft.com/pages/la_dashboard/ this is what we have, and it works for the most part, the only problem is i cant select more than one option in the drop down, as the list refines itself when I pick an option. Can anyone assist? Ive set the “multiple” option to true in the ODS-Select part Thanks RyanAuto-translation 🪄Bonjour à tous :) J'ai travaillé sur un tableau de bord basé sur la bibliothèque de codes à contexte multiple « https://codelibrary.opendatasoft.com/page-templates/dashboard-filter/#code-dashboard-with-filters-on-multiple-contexts-css-content » https://northernpowergrid.opendatasoft.com/pages/la_dashboard/ c'est ce que nous avons, et cela fonctionne pour la plupart, le seul problème est que je ne peux pas sélectionner plus d'

1147
thomas.pagotto
ODS Team
R
RyanMember
asked in Organize data
Adding descriptions in schema

Hi,Im trying to add descriptions to my schema, however when I enter my description the apply box stays greyed out.Any ideas why i cant seem to apply this change? Thanks RyanAuto-translation 🪄Bonjour, j'essaie d'ajouter des descriptions à mon schéma, mais lorsque je saisis ma description, la case d'application reste grisée. Avez-vous une idée de la raison pour laquelle je n'arrive pas à appliquer ce changement ? Merci Ryan

805
R
luciaonmatteo
luciaonmatteoBeginner
asked in Organize data
How Does OpenDataSoft Integrate with Popular Cloud Platforms Like AWS, Azure, and Google Cloud?

Hi everyone,I’ve been working on a project that involves handling large datasets, and I’m exploring how OpenDataSoft can be integrated with cloud computing platforms like AWS, Microsoft Azure, and Google Cloud.Here are some specific questions and thoughts I’d like to dive into:Built-In Connectors or APIs: Does OpenDataSoft provide native connectors for AWS, Azure, and Google Cloud? For example, can it easily connect to services like S3 (AWS), Blob Storage (Azure), or Google Cloud Storage? Setting Up Data Pipelines: How straightforward is it to establish data pipelines between OpenDataSoft and these cloud platforms? Are there any step-by-step guides or best practices for automating data transfers and updates? Real-Time Data Processing: Can OpenDataSoft handle real-time data streaming from cloud-based sources like Azure Event Hubs, AWS Kinesis, or Google Pub/Sub? If so, how is latency managed to ensure smooth operation? Data Security and Compliance: With data moving between OpenDataSoft

551
Rémy
Community Manager
F
FadwaBeginner
asked in Organize data
Sorting Issue: Facet Sorting Works in Exploration, But Not on Raw Data (for Numbers, Time Ranges, and Text)

Hello,I’m currently working on a dataset with different types of data (e.g., time ranges, numeric values, and text fields) and am facing an issue with sorting these data. I’d really appreciate your help in understanding and solving this problem.Context:My dataset contains the following types of columns:Time Ranges (e.g., "2020-2022", "2023-2024", "2020_2022") Numeric Values Text FieldsI need to sort these columns in ascending order (for numeric and time ranges) and alphabetically (for text fields).Problem:When I mark a column as a facet, the sorting applied works  in the Explore Data  for the faceted filters, but the raw dataset remains unsorted. What I Need:I need a way to:Apply sorting to the raw dataset itself (for both time ranges, numeric values, and text fields), so that the data is organized correctly in the raw dataset as well as in the Explore Data view.Additional Details:I’ve tried using different processors, like Expression or Add Field, to create sorting keys, but none of t

412
F
F
FadwaBeginner
asked in Organize data
Issue with Extracting Multiple Plain Text Blocks with the extract text processor.

Hello everyone,I’m currently facing a challenge with extracting plain text from HTML content, and I’m looking for some advice on how to resolve it.The issue arises when I try to extract all text segments located between various HTML tags. I’ve been using a regular expression to capture the text, but I’ve encountered a limitation where only the first occurrence of text is retrieved, while subsequent occurrences remain unextracted. The regular expression I’m using is:>(?P<texte_brut>[^<>]+)<This works for capturing the first block of text but doesn’t return the remaining segments found within the other tags. My goal is to extract all text occurrences embedded between HTML tags in a single process.For instance, given the following HTML:<p>Chers voyageurs,</p><p>En raison de travaux sur la commune de Vitrolles, les lignes 7 et 20 sont déviées du 25/09 au 31/12 de 6h à 21h.</p><p><strong>Arrêts non desservis :</strong></p>&lt

592
F
boris.djakovic
boris.djakovicMember
asked in Organize data
Chart Displays Data Despite Empty Selection in ODS Filter

Dear ODS-Community,I am experiencing an issue with the configuration of an ODS filter where the chart displays data even though no selection has been made in the dropdown. I would like the filter to have no default selection and for the chart to display no data until a selection is made.Details of the Problem:The dropdown filter is configured to allow the selection of a care home. The filter is initialized with the value "All Care Homes," which causes data to be displayed in the chart even when the user has not made a specific selection. I want the filter to be empty by default and for the chart to show no data until something is selected.Current Code:Here is the relevant code that I am currently using:               <div class="grid">                       <div class="shared-width-ods-selects">                    <div ods-facet-results="reglist"                         ods-facet-results-facet-name="name"                         ods-facet-results-context="myctx0"       

644
A
R
RyanMember
asked in Organize data
Undelete Datasets

Is there anyway to recover a deleted dataset? May of made a small error!ThanksRyanAuto-translation 🪄Existe-t-il un moyen de récupérer un ensemble de données supprimé ? J'ai peut-être fait une petite erreur ! Merci Ryan

271
Rémy
Community Manager
E
erikschaapBeginner
asked in Organize data
Base64 pictures

 I have a dataset containing Base64 pictures. I want to show the Base64 picture on the map. But when I try that, it shows the Base64 code instead of the picture. So it will not translate the Base64 code to a picture. However, when I use the Base64 code in the Studio, I can add the field containing the Base64 codes as the picture field in the popup configuration (see example picture).Is there a solution for this? Auto-translation 🪄J'ai un ensemble de données contenant des images Base64. Je souhaite afficher l'image Base64 sur la carte. Mais lorsque j'essaie, le code Base64 s'affiche au lieu de l'image. Il ne traduira donc pas le code Base64 en image. Cependant, lorsque j'utilise le code Base64 dans le Studio, je peux ajouter le champ contenant les codes Base64 comme champ d'image dans la configuration contextuelle (voir l'image d'exemple). Existe-t-il une solution à ce problème ?

702
E
O
orhan.saeediBeginner
asked in Organize data
ods-chart - sort legend and/or stacking of series

Hey everybody!Is it possible to order the legend or/and the stacking of the values so they ar the same:https://data.bs.ch/chart/embed/order-incorrect/ This is the corresponding code:<ods-dataset-context context="myctx" myctx-dataset="100392" myctx-parameters="{'disjunctive.wahljahr':true,'disjunctive.altersgruppe':true,'disjunctive.listenkurzbezeichnung':true,'disjunctive.geschlecht':true,'disjunctive.frauenanteil_liste':true}">    <ods-chart scientific-display="false" align-month="true">        <ods-chart-query context="myctx" field-x="wahljahr" maxpoints="0" stacked="percent" series-breakdown="altersgruppe">            <ods-chart-serie expression-y="anteil" chart-type="bar" function-y="SUM" color="range-Accent" display-units="true" display-values="true" scientific-display="true">            </ods-chart-serie>        </ods-chart-query>    </ods-chart></ods-dataset-context>Maybe there is something I have to do in the correpsonding dataset

1242
O
R
RyanMember
asked in Organize data
Geospatial information selection

Hi all,If a dataset contains both a geopoint and a geoshape, is there anyway to select which will be displayed when you add it onto a map for example ? By default it seems to show the shapes Thanks RyanAuto-translation 🪄Bonjour à tous,Si un ensemble de données contient à la fois un géopoint et une géoforme, est-il possible de sélectionner celui qui sera affiché lorsque vous l'ajouterez sur une carte par exemple ? Par défaut, il semble afficher les formes Merci Ryan

1354
danny.oneill
Christian Trachsel
Christian TrachselBeginner
asked in Organize data
JSON Processor

Is there a way to create the iJson rules interactively? Without such help, it is very time-consuming to extract well-structured JSON files. JSON array to multivalued processor - Opendatasoft : User guide and documentationAuto-translation 🪄Existe-t-il un moyen de créer les règles iJson de manière interactive ? Sans une telle aide, l’extraction de fichiers JSON bien structurés prend beaucoup de temps. Tableau JSON vers processeur multivalué - Opendatasoft : Guide utilisateur et documentation

691
david.thoumas
ODS Team

Hello there!

Ask away and you shall receive an answer.
Terms & ConditionsCookie settings
Opendatasoft Terms & Conditions Cookie settings