Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Below are recommendations for data processing and analysis needs for complex data transformations. 

...

 Export MethodScaleRequirements
E1Basic export interface0 - 50,000 rowsNone
E2Daily Saved Exports*0 - 500,000 rowsNone
E3CommCare Data Export Tool writes to an Excel file10,000 - 500,000 rows
  • Excel license
  • CommCare Data Export Tool set up
E4CommCare Data Export Tool writes to a database50,000 - 1,000,000+ rows
  • CommCare Data Export Tool set up
  • Database installed and configured
  • Best practice: Dedicated server to run CommCare Data Export Tool

...

 Analysis approachExport methodScaleRequirements
A1Export into Excel for manual analysis*E1, E2, E30 - 200,000 rows
  • Excel license
A2Export into Excel and use macros for analysisE1, E2, E31,000 - 200,000 rows
  • Excel license
  • VBA expertise
  • Helps to have a general sense of computational complexity to avoid performance concerns
A3

Export into a CSV and use either: a scripting language (Python, Ruby, Perl, etc), stats package (Stata, SPSS, SAS, R, MATLAB, etc), or business intelligence software (Tableau, Google Fusion Tables) for analysis

 

E1, E2, E350,000 - 1,000,000+ rows
  • Analysis software or programming language installed
  • Programming background
A4Export into a database and use database queries (SQL, etc) for analysisE450,000 - 1,000,000+ rows
A5Export into a database and use a web service to dynamically query the databaseE450,000 - 1,000,000+ rows
  • Database installed and configured
  • CommCare Data Export Tool set up
  • Web service installed and running on servers
  • Dedicated software engineer

...