Mobile Toolbox Status Summary - April/May 2023
- Sonia Carlson
Headlines
Our goal for the Mobile Toolbox Platform is to provide a complete end-to-end solution for the use of remotely-administered cognitive and other tests by researcher teams, without the need for any study-specific technology development. A complete solution must cover scenarios across the complete lifecycle of a study, and support research teams in:
Delivering timely, reliable, high-fidelity data to researchers
Providing well documented validated measures.
Learning about available mobile cognitive measures and designing appropriate digital research protocols.
Managing collection of data from study participants, including support for enrollment, aggregate/high-level adherence tracking, and participant communications.
Providing secure transfer of de-identified data to analysts.
Disseminating data, results, and other findings from completed studies for forms that encourage reuse by other research teams, subject to FAIR principles.
Highlights - April 2023
Schema refresh/ETL design complete
Pipeline release timing complete
need workback for mobile release
First time through release cadence
Detailed adherence report available on staging, in use by MGH
Monitoring and UAT caught a parquet fail which led to progress on identifying the long tail of parquet fails
Refined triage and release process for bugs/rebuild
Updated issue tracker for easier filtering and communications
Lowlights - April 2023
Timing was slightly off for release cadence UAT, delaying release
Null values coming from weather data caused parquet fails
Duplicate records due to re-processing during QA
Unexpected blockers to compute DCCS. Need additional input from scientific owner - may add delay
Did not get to Jira service desk metrics
Did not get joint sprint planning cadence on the schedule
Risks
Upcoming ICAR pilot and Vibrent validation studies in early June have compressed timeline
‘Bundled’ assessment schema support needs investigation to see if pipeline can support it in time
May will have a heavy focus on study onboarding, assessment metadata updates, and pipeline deployments
Monash/Vibrent contract extension. Tech work is not yet complete - Sage has not received updated builds since providing dev feedback in early April
Monthly summary
Where can I find information about…
*reach out to Sonia or Ann if you can’t access links
Data completion downloadable .csv
Jira Service Desk bug template - in progress
Jira Metrics - in progress
Jira Incident Manager - not started
Jira projects, backlogs, boards
ETL / Data Processing
Synapse Mobile Toolbox parent project
What are we working on? May 2023 our focus is on….
Description | Type | Expected output for end of month | Future work |
|---|---|---|---|
Compute scores for DCCS (shape-color sorting) based on inferred Response Time for Android users where direct collection of RT is missing. This is to recover from a bug where RT was not collected from Android users prior to build 26. | User facing |
|
|
Support for myCog ‘grouped’ assessment | Planning |
|
|
Detailed adherence report visible in the Researcher Portal UI that shows each assessment completion status, skipped status, and completion timestamp | User facing |
|
|
Schema refresh to support upcoming ICAR measure validation studies and update of existing measures | Infrastructure |
|
|
Jira Service Desk | Process | Mechanism for internal and external collaborators to file bugs in a template that propagates through to staging for triage |
|
Data re-processing of data ‘stuck’ in parquet queue | Issue resolution |
| investigate taskdata validation fails due to null value and finalize plan for go-forward |
Implement first phases of background recorder shutdown | User facing |
|
|
Implement logout capability | User facing | enabled in debug mode |
|
Create a way to expose/stage new assessments for specific studies | Infrastructure | Design complete for server implementation of study-level permissions | Implement UI/API to designate permissions |
Alerting reqs for adherence | User facing | Validation of UI |
|
Define criteria for onboarding new studies | Planning |
|
|
Communications
User facing feature requests
Feature | Description | Complexity | Priority | Delivery forecast |
|---|---|---|---|---|
Login/logout capability | Allow participant and preview accounts to logout and login so that data state is retained and cache i s properly cleared without deleting and reinstalling the app | high | 1 | TBD |
Turn off background recorders | part 1: turn off capability for researchers to optionally turn on recorders and defalut all study configs to OFF part 2: excise the implementation of the recorders on both Android and iOS |
| 2 | TBD |
Editable schedules | Allow changes to a schedule after a study has been launched | high | 2 | TBD. New studies can currently be manually constructed to have more flexibility. Existing studies will not be editable. New work will ensure that ALL new studies will automatically have more flexibility. |
Spanish language | Provide app and assessments to run studies ALL in english or ALL in spanish | medium | 2 | earliest Fall 2023 |
Self-service account setup | Allow public users to onboard to Mobile Toolbox to explore, and to launch studies with a verified identity | high | 1 | target late summer 2023 |
Self-service access controls | Allow Study Admins to invite users and have granular control over what team members can see and do with PII and study data | high | 1 | target late summer 2023 |
Custom Survey Authoring | Researchers can collaborate and construct custom survey questions that can be delivered to participants as part of their schedule of activities | high | 2 | Deprioritized. Target beta in Q3/Q4 |
Detailed Adherence completion reporting | Study Coordinators can see the details of completion status and date for every assessment administered | medium | 1 | April 2023 |
Adherence Alerts page | Study Coordinators can view alerts when participants fall below adherence thresholds or other events | medium | 2 | Q2 2023 |
Schema refresh | Update the schemas of assessments to optimize data processing | medium | 2 | pending implementation plan for schema refresh. Ask is to complete for May/June start of clinical study |
Automated scoring | Scores are automatically processed on-device or on a daily basis to keep up with ongoing data collection | medium | 1 | V1 complete |
Public website updates | Include suggested language for grant submissions, sample data, FAQs, About Us bios, more detailed assessment information | medium | 2 | Q3 2023 |
Customer support helpdesk | Ticketing and tracking system and knowledge base to scale up responses to issues reported by coordinators | high | 2 | Q3 2023 |
Product documentation | Update and publish product documentation | medium | 3 | May 2023 |
Crashlytics tuning | Improve crash and log collection from the mobile App to more quickly characterize and respond to bugs. | medium | 2 | Q2 2023 |
Data samples | Provide data samples so potential users can demo the app and explore data output without having to launch a study | low | 3 | Q2 2023 |
Demographics upload UI | Study Coordinators can upload demographics metadata so it can be automatically incorporated into data processing and analysis | medium | 3 | TBD |
OKRs and supporting initiatives - Work in progress….
<Objective 1>
on track / at risk / OFF Track
Key results |
|---|
<Objective 2>
on track / at risk / OFF Track
Key results |
|---|
<Objective 3>
on track / at risk / OFF Track
Key results |
Other updates
Engineering/Operational Health |
|---|
|
Customer insights |
|---|
|
Marketing Highlights |
|---|
|
Competitor insights |
|---|
|