🗞 Headlines
Our goal for the Mobile Toolbox Platform is to provide a complete end-to-end solution for the use of remotely-administered cognitive and other tests by researcher teams, without the need for any study-specific technology development. A complete solution must cover scenarios across the complete lifecycle of a study, and support research teams in:
Delivering timely, reliable, high-fidelity data to researchers
Providing well documented validated measures.
Learning about available mobile cognitive measures and designing appropriate digital research protocols.
Managing collection of data from study participants, including support for enrollment, aggregate/high-level adherence tracking, and participant communications.
Providing secure transfer of de-identified data to analysts.
Disseminating data, results, and other findings from completed studies for forms that encourage reuse by other research teams, subject to FAIR principles.
Highlights - May 2023
Got ICAR study launch to the finish line with intense coordination and entirely new schemas, ETL and scoring
DCCS and Flanker final resolution
Data state API completed in Bridge.
Identified the last long tail issue (underscore file name) of missing parquet data
no new issues from live studies
adherence report had first-look and feedback from coordinators
Additional feature squeezed in to incled ‘not completed status’
Lowlights - May 2023
Reprocessing of data with ‘underscore’ issue led to a broader error that broke completion.csv process
Unexpected metadata change caused missing startdate and enddate
Did not get to Jira service desk metrics
Did not get joint sprint planning cadence on the schedule
Risks
Compressed timeline allows for minimal data QA for ICAR study
Need to define QA and work plan for upcoming MyCogMobile study in mid-July
Need better process to validate schemas
Other updates
Progress on Monash binaries to get builds into sample apps
📈 Monthly summary
Where can I find information about…
*reach out to Sonia or Ann if you can’t access links
Data completion downloadable .csv
Jira Service Desk bug template - in progress
Jira Metrics - in progress
Jira Incident Manager - not started
Jira projects, backlogs, boards
ETL / Data Processing
Synapse Mobile Toolbox parent project
What are we working on? June 2023 our focus is on….
Description | Type | Expected output for end of month | Future work |
|---|---|---|---|
Compute scores for DCCS (shape-color sorting) based on inferred Response Time for Android users where direct collection of RT is missing. This is to recover from a bug where RT was not collected from Android users prior to build 26. | User facing |
|
|
Support for myCog ‘grouped’ assessment | Planning |
| none |
Define data processing states for internal and external exposure. Researchers will be able to see assessment level data status of completed on device, data processing, and data ready for analysis. Internal tools can see additional states (validation fail, parquet complete etc.) | Planning |
|
|
Define process and tools for more efficient schema validation | Planning | Work plan to prepare for upcoming schema refresh of core measures | Implementation of process and tools |
Detailed adherence report visible in the Researcher Portal UI that shows each assessment completion status, skipped status, and completion timestamp | User facing |
|
|
Jira Service Desk | Process | Mechanism for internal and external collaborators to file bugs in a template that propagates through to staging for triage |
|
Data re-processing of data ‘stuck’ in parquet queue | Issue resolution |
| investigate taskdata validation fails due to null value and finalize plan for go-forward |
Data re-processing of data ‘stuck’ in parquet queue | Issue resolution |
| Re-process data |
Implement next phases of background recorder shutdown | User facing |
|
|
Implement logout capability | User facing |
|
|
Create a way to expose/stage new assessments for specific studies | Infrastructure | Design complete for server implementation of study-level permissions | Implement UI/API to designate permissions |
Alerting reqs for adherence | User facing | Validation of UI | |
Define criteria for onboarding new studies | Planning |
|
|
Communications
📈 User facing feature requests
Feature | Description | Complexity | Priority | Delivery forecast |
|---|---|---|---|---|
Login/logout capability | Allow participant and preview accounts to logout and login so that data state is retained and cache i s properly cleared without deleting and reinstalling the app | high | 1 | TBD |
Turn off background recorders | part 1: turn off capability for researchers to optionally turn on recorders and defalut all study configs to OFF part 2: excise the implementation of the recorders on both Android and iOS | part 1 = low part 2 = high because of QA | 2 | Part 1 june 2023 |
Editable schedules | Allow changes to a schedule after a study has been launched | high | 2 | Post-renewal. Requires architectural overhaul. New studies can currently be manually constructed to have more flexibility. Existing studies will not be editable. New work will ensure that ALL new studies will automatically have more flexibility. |
Spanish language | Provide app and assessments to run studies ALL in english or ALL in spanish | medium | 2 | earliest Fall 2023 |
Self-service account setup | Allow public users to onboard to Mobile Toolbox to explore, and to launch studies with a verified identity | high | 1 | target fall 2023 |
Self-service access controls | Allow Study Admins to invite users and have granular control over what team members can see and do with PII and study data | high | 1 | target fall 2023 |
Custom Survey Authoring | Researchers can collaborate and construct custom survey questions that can be delivered to participants as part of their schedule of activities | high | 2 | Deprioritized. Target beta in Q3/Q4 |
Detailed Adherence completion reporting | Study Coordinators can see the details of completion status and date for every assessment administered | medium | 1 | April 2023 - completed |
Adherence Alerts page | Study Coordinators can view alerts when participants fall below adherence thresholds or other events | medium | 2 | Q2 2023 |
Schema refresh | Update the schemas of assessments to optimize data processing | medium | 2 | completed |
Automated scoring | Scores are automatically processed on-device or on a daily basis to keep up with ongoing data collection | medium | 1 | V1 complete |
Public website updates | Include suggested language for grant submissions, sample data, FAQs, About Us bios, more detailed assessment information | medium | 2 | Q3 2023 |
Customer support helpdesk | Ticketing and tracking system and knowledge base to scale up responses to issues reported by coordinators | high | 2 | Q3 2023 |
Product documentation | Update and publish product documentation | medium | 3 | July 2023 |
Crashlytics tuning | Improve crash and log collection from the mobile App to more quickly characterize and respond to bugs. | medium | 2 | Q2 2023 |
Data samples | Provide data samples so potential users can demo the app and explore data output without having to launch a study | low | 3 | Q2 2023 |
Demographics upload UI | Study Coordinators can upload demographics metadata so it can be automatically incorporated into data processing and analysis | medium | 3 | TBD |
🎯 OKRs and supporting initiatives - Work in progress….
<Objective 1>
ON TRACK / AT RISK / OFF TRACK
Key results |
|---|
|
<Objective 2>
ON TRACK / AT RISK / OFF TRACK
Key results |
|---|
|
<Objective 3>
ON TRACK / AT RISK / OFF TRACK
Key results |
|
(.) Other updates
💚 Engineering/Operational Health |
|---|
|
|---|
Customer insights📣 Marketing Highlights |
|---|
🎭 Competitor insights |
|---|
Add Comment