Skip to content

For Data Curators

This section provides guides and documentation for data curators who are responsible for preparing, validating, and loading data into IDhub.

Here you will find a set of guides to walk you through the process of getting data into IDhub. We recommend following them in order:

  1. Ingestion Overview: A high-level overview of the entire data ingestion process.
  2. Manual Ingestion Guide: The main guide, which includes:
    • Setting up your local computer to run the validator.
    • Preparing your data file.
    • Running the validation and loading process.
  3. Creating a Mapping File: A detailed walkthrough of how to create the JSON mapping file required by the validator.
  4. Example Data Templates: A collection of annotated CSV and JSON examples for each sample type.
  5. Troubleshooting Ingestion: A guide to understanding and fixing common data quality errors.
  6. Audit & Resolution Tables: An advanced guide to using the audit tables for in-depth troubleshooting.
  7. Automated REDCap Pipeline: Information on how the automated pipeline from REDCap works.
  8. Exploring Data: