Skip to main content

Organize data

Improve the quality of your data with our processors and enrich it with third-party data.

  • 18 Topics
  • 37 Replies
18 Topics
darioschiraldi99
darioschiraldi99Seeker
asked in Organize data
Dario Schiraldi - How do I perform a data join in SQL or Python?

Hi everyone,I’m Dario Schiraldi currently working on a project where I need to join multiple datasets, and I’d love to hear your suggestions on the best practices for performing data joins. Specifically, I’m interested in methods for both SQL and Python.I’d appreciate any insights, tips, or resources you have! Thanks in advance!RegardsDario Schiraldi CEO of Travel Works 

90
darioschiraldi99
hindujafamilyswiss
hindujafamilyswissSeeker
asked in Organize data
What is Schema management for datasets ?

Hi,My name is  Prakash Hinduja (Hinduja Family Swiss) , I want to know about the Schema management for datasets and why it is important .  Regards:Prakash Hinduja (Hinduja Family Switzerland)

70
hindujafamilyswiss
K
kamalhindujaSeeker
asked in Organize data
Kamal Hinduja Geneva, Switzerland : How Opendatasoft integration with Public Datasets?

Hello everyone,I’m Kamal Hinduja from Geneva, Switzerland. I’m new to this community and look forward to contributing positively to the discussions while learning from your insights. Could someone please explain how Open data soft integrates with public datasets? Thanks in Advance!Kamal Hinduja Geneva, Switzerland  

261
boris.djakovic
R
RyanGuide
asked in Organize data
Editing geopoint schema

Hi,I understand that geopoint schemas cant be edited when they are the centre of a geoshape, but is there anyway to still be able to edit the description? Mainly to state that this point is in fact the centre of the shape and not a location point (see below) Thanks Ryan

252
benjamin.moreau
ODS Team
Yanik Kipfer
Yanik KipferSeeker
asked in Organize data
Adding translations via Automation API

Is there a way to add metadata and dataset schema translations (e.g. in english or italian) via the Automation API?

451
L
ODS Team
Y
yvonneGuardian
asked in Organize data
Join datasets spatially

HiI’m trying to join a couple of datasets spatially.In Dataset A I have a geopoint (lat/long)In Dataset B I have a list of attributes in a polygon (shape) I want to use the geopoint in Dataset A as the key for Dataset B and return one or more columns from Dataset B…  Thank you for any options :)

341
Maimuna Ahmed
Community Manager
R
RenatoFSeeker
asked in Organize data
Retrieve column types through Automation API 1.0

Hi everyone,I'm working with the ODS Automation API (v1) and I'm trying to retrieve the data types of columns in a dataset. When using the `/datasets/{dataset_uid}/fields` endpoint, I receive a list of field configurations that includes annotations (facet, timerangeFilter, etc.) and rename operations, but I'm having trouble finding the actual data types of the columns (like text, date, integer).Here's an example of what I get from the endpoint (for fields related to the ‘end_date’ field, which is of type ‘date’):[{'annotation': 'facet', 'args': [], 'field': 'end_date', 'label': '', 'type': 'annotation', 'uid': 'pr_toc04f'}{'annotation': 'facetsort', 'args': ['alphanum'], 'field': 'end_date', 'label': '', 'type': 'annotate', 'uid': 'pr_adjonu'}{'annotation': 'timerangeFilter', 'args': [], 'field': 'end_date', 'label': '', 'type': 'annotate', 'uid': 'pr_yv06h9'}{'field_label': 'Enddatum', 'from_name': 'end_date', 'label': '', 'to_name': 'end_date', 'type': 'rename', 'uid': 'pr_xh8w8e'}]W

231
R
R
RyanGuide
asked in Organize data
Multile filter selection on a multiple context dashboard

Hi All :)Ive been working on a dashboard based on the mutlple context code libary piece “https://codelibrary.opendatasoft.com/page-templates/dashboard-filter/#code-dashboard-with-filters-on-multiple-contexts-css-content” https://northernpowergrid.opendatasoft.com/pages/la_dashboard/ this is what we have, and it works for the most part, the only problem is i cant select more than one option in the drop down, as the list refines itself when I pick an option. Can anyone assist? Ive set the “multiple” option to true in the ODS-Select part Thanks RyanAuto-translation 🪄Bonjour à tous :) J'ai travaillé sur un tableau de bord basé sur la bibliothèque de codes à contexte multiple « https://codelibrary.opendatasoft.com/page-templates/dashboard-filter/#code-dashboard-with-filters-on-multiple-contexts-css-content » https://northernpowergrid.opendatasoft.com/pages/la_dashboard/ c'est ce que nous avons, et cela fonctionne pour la plupart, le seul problème est que je ne peux pas sélectionner plus d'

1187
thomas.pagotto
ODS Team
R
RyanGuide
asked in Organize data
Adding descriptions in schema

Hi,Im trying to add descriptions to my schema, however when I enter my description the apply box stays greyed out.Any ideas why i cant seem to apply this change? Thanks RyanAuto-translation 🪄Bonjour, j'essaie d'ajouter des descriptions à mon schéma, mais lorsque je saisis ma description, la case d'application reste grisée. Avez-vous une idée de la raison pour laquelle je n'arrive pas à appliquer ce changement ? Merci Ryan

835
R
luciaonmatteo
luciaonmatteoSeeker
asked in Organize data
How Does OpenDataSoft Integrate with Popular Cloud Platforms Like AWS, Azure, and Google Cloud?

Hi everyone,I’ve been working on a project that involves handling large datasets, and I’m exploring how OpenDataSoft can be integrated with cloud computing platforms like AWS, Microsoft Azure, and Google Cloud.Here are some specific questions and thoughts I’d like to dive into:Built-In Connectors or APIs: Does OpenDataSoft provide native connectors for AWS, Azure, and Google Cloud? For example, can it easily connect to services like S3 (AWS), Blob Storage (Azure), or Google Cloud Storage? Setting Up Data Pipelines: How straightforward is it to establish data pipelines between OpenDataSoft and these cloud platforms? Are there any step-by-step guides or best practices for automating data transfers and updates? Real-Time Data Processing: Can OpenDataSoft handle real-time data streaming from cloud-based sources like Azure Event Hubs, AWS Kinesis, or Google Pub/Sub? If so, how is latency managed to ensure smooth operation? Data Security and Compliance: With data moving between OpenDataSoft

581
Rémy
Community Manager
F
FadwaSeeker
asked in Organize data
Sorting Issue: Facet Sorting Works in Exploration, But Not on Raw Data (for Numbers, Time Ranges, and Text)

Hello,I’m currently working on a dataset with different types of data (e.g., time ranges, numeric values, and text fields) and am facing an issue with sorting these data. I’d really appreciate your help in understanding and solving this problem.Context:My dataset contains the following types of columns:Time Ranges (e.g., "2020-2022", "2023-2024", "2020_2022") Numeric Values Text FieldsI need to sort these columns in ascending order (for numeric and time ranges) and alphabetically (for text fields).Problem:When I mark a column as a facet, the sorting applied works  in the Explore Data  for the faceted filters, but the raw dataset remains unsorted. What I Need:I need a way to:Apply sorting to the raw dataset itself (for both time ranges, numeric values, and text fields), so that the data is organized correctly in the raw dataset as well as in the Explore Data view.Additional Details:I’ve tried using different processors, like Expression or Add Field, to create sorting keys, but none of t

452
F
F
FadwaSeeker
asked in Organize data
Issue with Extracting Multiple Plain Text Blocks with the extract text processor.

Hello everyone,I’m currently facing a challenge with extracting plain text from HTML content, and I’m looking for some advice on how to resolve it.The issue arises when I try to extract all text segments located between various HTML tags. I’ve been using a regular expression to capture the text, but I’ve encountered a limitation where only the first occurrence of text is retrieved, while subsequent occurrences remain unextracted. The regular expression I’m using is:>(?P<texte_brut>[^<>]+)<This works for capturing the first block of text but doesn’t return the remaining segments found within the other tags. My goal is to extract all text occurrences embedded between HTML tags in a single process.For instance, given the following HTML:<p>Chers voyageurs,</p><p>En raison de travaux sur la commune de Vitrolles, les lignes 7 et 20 sont déviées du 25/09 au 31/12 de 6h à 21h.</p><p><strong>Arrêts non desservis :</strong></p>&lt

592
F
boris.djakovic
boris.djakovicGuide
asked in Organize data
Chart Displays Data Despite Empty Selection in ODS Filter

Dear ODS-Community,I am experiencing an issue with the configuration of an ODS filter where the chart displays data even though no selection has been made in the dropdown. I would like the filter to have no default selection and for the chart to display no data until a selection is made.Details of the Problem:The dropdown filter is configured to allow the selection of a care home. The filter is initialized with the value "All Care Homes," which causes data to be displayed in the chart even when the user has not made a specific selection. I want the filter to be empty by default and for the chart to show no data until something is selected.Current Code:Here is the relevant code that I am currently using:               <div class="grid">                       <div class="shared-width-ods-selects">                    <div ods-facet-results="reglist"                         ods-facet-results-facet-name="name"                         ods-facet-results-context="myctx0"       

674
A
R
RyanGuide
asked in Organize data
Undelete Datasets

Is there anyway to recover a deleted dataset? May of made a small error!ThanksRyanAuto-translation 🪄Existe-t-il un moyen de récupérer un ensemble de données supprimé ? J'ai peut-être fait une petite erreur ! Merci Ryan

311
Rémy
Community Manager
E
erikschaapSeeker
asked in Organize data
Base64 pictures

 I have a dataset containing Base64 pictures. I want to show the Base64 picture on the map. But when I try that, it shows the Base64 code instead of the picture. So it will not translate the Base64 code to a picture. However, when I use the Base64 code in the Studio, I can add the field containing the Base64 codes as the picture field in the popup configuration (see example picture).Is there a solution for this? Auto-translation 🪄J'ai un ensemble de données contenant des images Base64. Je souhaite afficher l'image Base64 sur la carte. Mais lorsque j'essaie, le code Base64 s'affiche au lieu de l'image. Il ne traduira donc pas le code Base64 en image. Cependant, lorsque j'utilise le code Base64 dans le Studio, je peux ajouter le champ contenant les codes Base64 comme champ d'image dans la configuration contextuelle (voir l'image d'exemple). Existe-t-il une solution à ce problème ?

792
E
O
orhan.saeediSeeker
asked in Organize data
ods-chart - sort legend and/or stacking of series

Hey everybody!Is it possible to order the legend or/and the stacking of the values so they ar the same:https://data.bs.ch/chart/embed/order-incorrect/ This is the corresponding code:<ods-dataset-context context="myctx" myctx-dataset="100392" myctx-parameters="{'disjunctive.wahljahr':true,'disjunctive.altersgruppe':true,'disjunctive.listenkurzbezeichnung':true,'disjunctive.geschlecht':true,'disjunctive.frauenanteil_liste':true}">    <ods-chart scientific-display="false" align-month="true">        <ods-chart-query context="myctx" field-x="wahljahr" maxpoints="0" stacked="percent" series-breakdown="altersgruppe">            <ods-chart-serie expression-y="anteil" chart-type="bar" function-y="SUM" color="range-Accent" display-units="true" display-values="true" scientific-display="true">            </ods-chart-serie>        </ods-chart-query>    </ods-chart></ods-dataset-context>Maybe there is something I have to do in the correpsonding dataset

1352
O
R
RyanGuide
asked in Organize data
Geospatial information selection

Hi all,If a dataset contains both a geopoint and a geoshape, is there anyway to select which will be displayed when you add it onto a map for example ? By default it seems to show the shapes Thanks RyanAuto-translation 🪄Bonjour à tous,Si un ensemble de données contient à la fois un géopoint et une géoforme, est-il possible de sélectionner celui qui sera affiché lorsque vous l'ajouterez sur une carte par exemple ? Par défaut, il semble afficher les formes Merci Ryan

1384
danny.oneill
Christian Trachsel
Christian TrachselSeeker
asked in Organize data
JSON Processor

Is there a way to create the iJson rules interactively? Without such help, it is very time-consuming to extract well-structured JSON files. JSON array to multivalued processor - Opendatasoft : User guide and documentationAuto-translation 🪄Existe-t-il un moyen de créer les règles iJson de manière interactive ? Sans une telle aide, l’extraction de fichiers JSON bien structurés prend beaucoup de temps. Tableau JSON vers processeur multivalué - Opendatasoft : Guide utilisateur et documentation

701
david.thoumas
ODS Team

Hello there!

Ask away and you shall receive an answer.
Terms & ConditionsCookie settings
Opendatasoft Terms & Conditions Cookie settings