Mobile Toolbox Status Summary - June/July 2023
- Sonia Carlson
Headlines
Our goal for the Mobile Toolbox Platform is to provide a complete end-to-end solution for the use of remotely-administered cognitive and other tests by researcher teams, without the need for any study-specific technology development. A complete solution must cover scenarios across the complete lifecycle of a study, and support research teams in:
Delivering timely, reliable, high-fidelity data to researchers
Providing well documented validated measures.
Learning about available mobile cognitive measures and designing appropriate digital research protocols.
Managing collection of data from study participants, including support for enrollment, aggregate/high-level adherence tracking, and participant communications.
Providing secure transfer of de-identified data to analysts.
Disseminating data, results, and other findings from completed studies for forms that encourage reuse by other research teams, subject to FAIR principles.
Highlights - June 2023
MyCogMobile initial incorporation into production app
Long tail of missing parquet data (underscore file name issue) final resolution for live studies and construct validation
Resolution of missing startdate and enddate metadata
Operationalization of scoring code is in progress
Progress on manuscripts
Improved documentation of Bridge Downstream setup processes
Lowlights - June 2023
Glue bug continues to produce unpredictable results, slowing down data analysis and start for ICAR
Data export delays due to sluggish queues
new issue reported with long session window schedule delivery
Did not get to Jira service desk metrics
Did not get joint sprint planning cadence on the schedule
Risks
Personnel and function transitions with departure of Larsson
Summer schedules and temporary leave
Need better process to validate schemas
Completed PoC of Monash binaries to get builds into production app
Monthly summary
Where can I find information about…
*reach out to Sonia or Ann if you can’t access links
Data completion downloadable .csv
Jira Service Desk bug template - in progress
Jira Metrics - in progress
Jira Incident Manager - not started
Jira projects, backlogs, boards
ETL / Data Processing
Synapse Mobile Toolbox parent project
What are we working on? July 2023 our focus is on….
Description | Type | Expected output for end of month | Future work |
|---|---|---|---|
Implement solution to mitigate ‘Glue bug’ to unblock ICAR and future studies | User facing |
|
|
Scoring code operationalization | Infrastructure |
|
|
iOS support for MyCogMobile ‘grouped’ assessment | User facing |
| none |
Define data processing states for internal and external exposure. Researchers will be able to see assessment level data status of completed on device, data processing, and data ready for analysis. Internal tools can see additional states (validation fail, parquet complete etc.) | Planning |
|
|
Define process and tools for more efficient schema validation | Planning | Work plan to prepare for upcoming schema refresh of core measures | Implementation of process and tools |
Jira Service Desk | Process | Mechanism for internal and external collaborators to file bugs in a template that propagates through to staging for triage |
|
Data re-processing of data ‘stuck’ in parquet queue | Issue resolution |
|
|
Implement next phases of background recorder shutdown | User facing |
|
|
Implement logout capability | User facing |
|
|
Create a way to expose/stage new assessments for specific studies | Infrastructure | Design complete for server implementation of study-level permissions | Implement UI/API to designate permissions |
Alerting reqs for adherence | User facing | deferred | Validation of UI |
Define criteria for onboarding new studies | Planning |
|
|
Provide item-level response times persistent for users, prior to public release of data (Color-shape sorting, Arrows) | Planning |
|
|
Communications
User facing feature requests
Feature | Description | Complexity | Priority | Delivery forecast |
|---|---|---|---|---|
Upgrade and unify build processes for production app | medium | TBD | TBD | |
Login/logout capability | Allow participant and preview accounts to logout and login so that data state is retained and cache i s properly cleared without deleting and reinstalling the app. Supports preview and ‘recycled’ phone scenarios | high | 1 | August release 2023 |
Turn off background recorders | part 1: turn off capability for researchers to optionally turn on recorders and defalut all study configs to OFF part 2: excise the implementation of the recorders on both Android and iOS | part 1 = low part 2 = high because of QA | 2 | July 2023 |
Editable schedules | Allow changes to a schedule after a study has been launched | high | 2 | Post-renewal. Requires architectural overhaul. New studies can currently be manually constructed to have more flexibility. Existing studies will not be editable. New work will ensure that ALL new studies will automatically have more flexibility. |
Spanish language | Provide app and assessments to run studies ALL in english or ALL in spanish | medium | 2 | earliest Fall 2023 |
Self-service account setup | Allow public users to onboard to Mobile Toolbox to explore, and to launch studies with a verified identity | high | 1 | target fall 2023 |
Self-service access controls | Allow Study Admins to invite users and have granular control over what team members can see and do with PII and study data | high | 1 | target fall 2023 |
Custom Survey Authoring | Researchers can collaborate and construct custom survey questions that can be delivered to participants as part of their schedule of activities | high | 2 | Deprioritized. Target beta in Q3/Q4 |
Detailed Adherence completion reporting | Study Coordinators can see the details of completion status and date for every assessment administered | medium | 1 | April 2023 - completed |
Adherence Alerts page | Study Coordinators can view alerts when participants fall below adherence thresholds or other events | medium | 2 | Q2 2023 |
Schema refresh | Update the schemas of core assessments to optimize data processing | medium | 2 | post-renewal |
Automated scoring | Scores are automatically processed on-device or on a daily basis to keep up with ongoing data collection | medium | 1 | V1 complete |
Public website updates | Include suggested language for grant submissions, sample data, FAQs, About Us bios, more detailed assessment information | medium | 2 | Q3 2023 |
Customer support helpdesk | Ticketing and tracking system and knowledge base to scale up responses to issues reported by coordinators | high | 2 | Q3 2023 |
Product documentation | Update and publish product documentation | medium | 3 | oost-renewal October 2023 |
Crashlytics tuning | Improve crash and log collection from the mobile App to more quickly characterize and respond to bugs. | medium | 2 | Q2 2023 |
Data samples | Provide data samples so potential users can demo the app and explore data output without having to launch a study | low | 3 | Q2 2023 |
Demographics upload UI | Study Coordinators can upload demographics metadata so it can be automatically incorporated into data processing and analysis | medium | 3 | TBD |
OKRs and supporting initiatives - Work in progress….
<Objective 1>
on track / at risk / OFF Track
Key results |
|---|
<Objective 2>
on track / at risk / OFF Track
Key results |
|---|
<Objective 3>
on track / at risk / OFF Track
Key results |
Other updates
Engineering/Operational Health |
|---|
|
Customer insights |
|---|
|
Marketing Highlights |
|---|
|
Competitor insights |
|---|
|