Content Comparison

Missing DCCS (Shape-Color Sorting) data

Response time is not always captured, causing the score computation to break down

Confirmed impact in MGH and UCSD data. Likely all sites impacted.

1

1/13/2023

Investigation in progress

Aaron K., Keith A.

1. fix logic in shared json schema to capture/validate response time going forward. Will require App update and potential change to Parquet processing and scoring.

2. evaluate cases to possibly reconstruct scores from user interaction data. May need to adjust scoring code for one-off re-computation of existing data

Missing Flanker (Arrow Matching) data

Error in score computation fails to produce a score. Source data exists, but needs to be recomputed

Confirmed impact in UCSF data. Likely all sites impacted.

2

1/20/2023

Open

Aaron K., Larsson O. (with Hugh and Vijay)

1. fix scoring code, no upstream data processing needed

2. recompute scores for all sites (1-2 days) after updating scoring code

Missing data uploads

Upload files are sometimes broken, data is stuck on participant’s phone.

*Some normal upload attrition is expected in remote mobile studies due to network errors, device types, and other unpredictable phone states.

All sites impacted. Android data disproportionately affected.

1

Investigation in progress

Sonia, Nate B.

1. data prior to Android build 26 (mid-January 2023 release) has old MD5 hash on the upload files, causing upload failure even though the queue retries the upload

App freezes between Vocab and Spelling assessments

Participant completes Vocab assessment, Spelling assessment freezes and participant can’t progress

One report from UCSD. Unknown if systemic issue, may be Samsung device specific

3

1/19/2023

Open

Sonia, Nate B., Keith A.

TBD

Missing Android data in Synapsebackground data

Validation rules are too restrictive, causing some data to fail processing.

Impact is to background recorder microphone data

3

In progress

Sonia, Phil, Vijay

1. Loosen validation rules

2. re-run Parquet

Schedule delivery stops working

New activities stop being delivered to participant’s phone after first two of five timepoints

UCSD

2

Open

Sonia, Nate B.

Painful workaround exists to assign participants a new ID, merge final data.

login/logout capability

high

2

TBD

Editable schedules

high

1

TBD. New studies can currently be constructed to have more flexibility, but existing studies will not be editable.

Spanish language

medium

2

mid-summer 2023

Self-service account setup

high

1

late summer 2023

Self-service access controls

high

1

late summer 2023

Custom Survey Authoring

high

2

BETA in Q2 2023

Detailed Adherence completion reporting

medium

1

Q1 2023

Adherence Alerts page

medium

2

Q1 2023

New assessments

medium

2

Varies. Several new assessments already integrated and in queue for May 2023

Schema refresh

medium

2

Q2 - TBD

Automated scoring

medium

1

Q1 2023

Public website updates

medium

1

Q1 and Q2 2023

Customer support helpdesk

high

2

Q2 2023

Product documentation

low

3

May 2023

Crashlytics tuning

medium

2

Q2 2023

Data samples

low

3

Q1 2023

Demographics upload UI

medium

3

TBD