Content Comparison

• Incomplete data delivery as data analysis Beta phase ramps-up

• Bugs and glitches throughout the study life cycle

• Usability gaps and unsupported scenarios

  • Editing a schedule

  • Login/logout

  • Participant device switching

  • Detailed adherence reporting

• Limited communication and visibility into status and impact

• High priority work items competing for scarce resources.

• Infrastructural investments needed for QA, development and staging environments, and continuous maintenance.

• No maintenance resources for product documentation updates.

• As MTB completes Beta and addresses remaining work items for major feature delivery and bug fixes, the focus turns to hardening processes and scaling up:

  • QA & bug management

  • Customer Support

  • Fixing usability gaps

  • Providing self-serve access to Mobile Toolbox

  • Producing public facing documentation and materials

  • Adoption ramp-up

Key Platform features already delivered or in development:

Researchers can:

1. Construct study schedules including remote study bursts based on clinical visits or other triggers that have unpredictable dates.

2. Setup schedules that have recurring repetitions and custom time windows for participants to complete assessments.

3. Customize communications with participants through branded app messaging and pre-set notifications.

4. Optionally collect passive background phone data.

5. Preview the participant app experience before launching a study.

6. Asynchronously enroll participants and manage their enrollment status.

7. Track high-level individual participant adherence and “day in study” through the lifetime of the study.

8. Access processed score data (full automation complete by Q1 2023).

9. Provide study metadata

10. Engage in a BETA for custom survey authoring (coming Q2 2023)

Participants can:

1. Freely download the public Mobile Toolbox app from either the Google Play Store or the Apple App Store.

2. Securely login with a de-identified code.

3. Optionally receive notifications and reminders.

4. Automatically receive scheduled assessments per researcher instruction.

5. Can choose to skip, pause, and continue assessments at any time.

6. Receive practice instructions for each assessment.

7. Actively opt-in or out of background data collection, review privacy information at any time, have access to general study and IRB contact information to request withdrawal.

Analysts can:

1. Access all item-level data in Parquet format as well as post-processed scores as spreadsheet downloads. Analysts can access these resources using R, Python, or web clients.

2. Access continuously updated data (completion in Q1 2023)

3. View aggregate statistics and user activity metrics per study.

4. View documentation on these tools.

1. Met criteria for Go-ahead to restart MGH study. Data collection has started and is at 100% fidelity

2. Fixed in production edge scenarios with schedule delivery and sign-in for mobile clients

3. Crashlytics monitoring deployed on iOS

4. Progress on defining weekly release cadence and criteria. Will finalize process over the next two sprint cycles

5. New devops viz tool identified an issue with Parquet exporter. Issue is now fixed and in code review

6. Baseline QA metrics defined. Next step to socialize, signoff and build dashboard

7. Centralized issue tracker up and in-use for active triage. Still needs refinement.

• Reports of PSM issues

• Need to close on background recorder decisions otherwise PSM issue is not addressable

• manual onboarding process is documented

• have received new binaries from Monash group

• server work is complete to support growth of assessment library