| Info |
|---|
New community supported open source tool These features are supported by the CommCare Community of Practice. While Support for these features is not included as part of your CommCare subscription, please feel free to refer any questions or issues about the content of these pages to the CommCare Forum. |
...
Table of Contents
About CommCare Sync
...
| Excerpt |
|---|
CommCare Sync is a self-hosted, standalone, web-based |
...
app that can be used to manage a CommCare “data warehouse.” |
...
It’s a suite of |
...
configurations, with an improved |
...
UX from the |
...
command- |
...
line Data Export Tool. This turn-key tool allows you to export your data from |
...
CommCare and save it to a local or cloud-based database ( |
...
MySQL, PostgresSQL, Amazon RDS, GCP Cloud SQL, |
...
Azure SQL Database). |
...
| Table of Contents | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
|
| Multiexcerpt include macro | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|
|
Installation
If you wish to try out, or self-host CommCare Sync, you can do so by setting it up from the source code which is available in the commcare-sync Github repository.
For help installing and managed production environments you can follow the documentation of the commcare-sync ansible repository.
Note that Dimagi does not provide support for self-hosted environments. For any issues or questions on hosting, please post to the open source developer forums. If you want Dimagi help hosting CommCare Sync, you can contactour delivery team.
Functionality
This set of tools provides a user-friendly interface for administrators to set up their CommCare data pipeline. The functionality includes the ability to:
Automatically generatea Data Export Tool config file from CommCare.
Create project space(s) in CommCare Sync, connected to your CommCare project space(s) and your database(s)
Upload a DET config file that will automatically pull data from your CommCare project space to your database on a set schedule
Monitor your data syncs via CommCare Sync's log feature
...
In CommCare HQ Data page, create a form or case export
Download the DET config file
Open your Excel DET config file to see the fields from your export with the option of mapping specific data types. If you aren't transforming your data, there's no step needed here.
Open CommCare Sync, create a new account (instructions below)
Add a project by pasting your CommCare project space name
Add your database via the Admin Site (can be any available database)
Add an export from your new project, and add your database and your config file you downloaded in step 2
Run export. This applies the configuration file to do an initial sync of all the data from your CommCare project space.
View the log to see more info - like to confirm how much data was pulled in
Connect your BI tool of choice, and start exploring the data
Note for projects syncing data from multiple CommCare project spaces:
...
Download your DET config file from CommCare
Download or create a Data Export Toolconfig file.
The easiest way to create these is to start with a normal export configuration on HQ and have it generated. See Creating an Excel Query File in CommCare HQ https://dimagi.atlassian.net/wiki/x/JCrKfw for more details.
Edit the DET file using the “best practices” below
...
If you haven’t already, add the CommCare project space in the “CommCare Setup” tab.
If you haven’t already, add a CommCare account that has access to the project space.
Important note to Dimagi users: Do NOT use your superuser @dimagi.com account, follow the steps below to create a user below. Create a web user for a specific project, and set up API key for that user (under Account Settings). You can use a "+" in your email address that tells you what your web user is for. e.g. "firstnamelastname+demo-cc-sync@dimagi.com"
Add the export from the “Exports” tab.
On the export details page, click “run”.
When the run completes, view the logs to confirm it ran successfully.
...
Databases can be added by site admins by using the "databases" link in CommCare Sync sidebar navigation. The database may need to also be separately created by a system admin on the server.
Administration
System administartion administration is documented in our production environment documentation.