Collecting, Processing, and Analyzing Data
The collection stage encompasses the methods and processes necessary for acquiring and creating datasets. Next comes the processing stage, an intermediate phase that involves a series of activities aimed at verifying, sorting, filtering, and preparing the data for further analysis. The analysis stage consists of exploring, summarizing, and interpreting the data in order to extract relevant information. Although these activities correspond to distinct stages of the data lifecycle, we will treat them here as a cohesive whole, since the recommendations associated with them are essentially the same.
To ensure the reproducibility of the research and to facilitate the reuse of data by other researchers after the project is completed, it is strongly recommended to carefully document, at each of these stages, the choices made by the team, the methods and tools used, as well as the different types of data collected. This documentation helps maintain a record of the collection, processing, and analysis processes, while facilitating the understanding and reuse of the data. Furthermore, adherence to best practices and discipline-specific standardized protocols is essential to ensure data interoperability and facilitate its use by other researchers.
Data Types and Acquisition Methods
| Data Type | Characteristics | Examples |
|---|---|---|
| Observational data | Collected in real time or in the field. Non-reproducible. Long-term preservation | Astronomical image, neuroimaging, precipitation records, ethnographic observation, field notes |
| Experimental data | Produced in a controlled setting. Reproducible but costly. | Genome sequence, chromatography, behavioral tests, experiments in psychology or economics |
| Computational data | Generated by numerical models or algorithms. Reproducible if the code and model are described. | Seismic simulation, climate models, social or network modeling. |
| Derived/compiled data | Raw data resulting from processing or analysis. Traceability is important. | 3D models, text mining, statistical databases, annotated linguistic corpora. |
| Reference or canonical data | Validated, stable collections used as references. | Genomic databases, spatial data portals, lexical databases (Frantext, TCOF). |
| Survey data | Collected via questionnaires, interviews, or recordings from survey respondents. Their processing and storage must comply with the requirements of the GDPR. | Completed paper questionnaires, video interviews. |
| Corpora | Data or documents aggregated for analysis. | Literary corpora, medical imaging corpora |
In certain projects, one may feel that no data is being produced. In such cases, it is important to examine the preparatory materials for publications and identify those whose loss would constitute irreparable damage to the ongoing research. It is these materials that can constitute the data for this type of project.
Reproducibility: Open Formats, Disciplinary Standards, and Documentation
The issue of reproducibility is central to modern research. Research data must be collected in such a way that the acquisition process can be replicated, thereby ensuring the integrity of the datasets.
It is therefore essential to share the protocols and scripts associated with data collection, analysis, and visualization processes. It is also important to document these various steps using a laboratory notebook, whether paper or electronic.
The humanities and social sciences are not exempt from the challenges of reproducibility. Over the past two decades, these fields have undergone significant changes, particularly driven by the rise of digital humanities practices. New methods and technologies are gaining prominence, and research organizations are emerging to offer training and guidance in this specific field.
For best practices regarding metadata, documentation, and data organization, please visit the dedicated page.
Focus on File Formats
The use of open file formats is central to the challenges of reusability and reproducibility. It is important to prioritize open file formats, which have the following characteristics:
• they are transparently encoded;
• their specifications are publicly available;
• they are interoperable;
• they can be created, read, and edited by different software programs designed to handle the file type in question.
If you are required to use proprietary formats, specify the software or tools used to create the files in the ReadMe file and in the metadata. Clearly state the name, publisher, or manufacturer, as well as the version used.
Note that the steps involved in data collection and analysis are highly specific to each research field. Research data management support units, such as LabRADoR, may therefore face difficulties in adhering to all best practices and standardized methods in order to provide appropriate support. For these discipline-specific aspects, scientific platforms are often the best points of contact. You can also find information through national research infrastructures, particularly the thematic reference centers of Recherche Data Gouv.
The Legal Framework
Before beginning any data collection or processing, it is essential to consider the legal and/or ethical framework. The collection and processing of certain types of data must comply with varying degrees of strictness. Here are a few examples:
- Compliance with copyright laws for intellectual works
- Compliance with the General Data Protection Regulation (GDPR) and image rights laws for the collection of personal data
- Compliance with the Jardet Law for research involving human subjects
To learn about the legal framework specific to your type of data, contact us or visit the Jurisdor platform.