Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Excerpt

No two CommCare projects are identical. Therefore, users may encounter varying requirements for data processing and visualization needs that could change over time. This

...

page presents various options for CommCare data processing and analysis to help users setup robust data pipelines via CommCare.

Every CommCare project will eventually need to interpret the Case and Form data collected by mobile workers. The design of a data pipeline involves two fundamental questions: the method of export (e.g., basic export interface) and the automation of analysis (e.g., VBA queries). Both of these aspects should be regularly reassessed in projects planning large-scale data analysis (exporting 50,000+ rows at a time).

Method of Export

Scale (rows)

Requirements

Documentation

Data Exports

0 - 50,000

Excel

Data Exports

Daily Saved Exports

0 - 100,000

Excel

Daily Saved Exports

OData Feeds

0 - 500,000

PowerBI/Tableau Desktop

OData Feeds

CommCare Data Export Tool

0 - 1,000,000+

Excel, Python, programming knowledge, database knowledge, server setup

CommCare

Sync

0 - 1,000,000+

Excel, Python, programming knowledge, database knowledge, server setup

Data Export Tool (DET)

Info

Data Exports

The basic data exports interface in CommCare allows exporting up to 50,000 rows of case and form data submitted by mobile workers. CommCare offers robust data exporting features with the ability to customise exports as needed.

...

See CommCare Data Export Tool (DET) for more.

Info

CommCare Sync

CommCare Sync can be used for running concurrent exports from multiple project spaces into a SQL database. CommCare Sync is an open source tool with a GUI that allows setting up and running multiple exports at the same time. This is ideal for a larger organisation requiring data exports from different project spaces (for example, country teams, project teams). See CommCare Sync for more.