Content Comparison

Compute scores for DCCS (shape-color sorting) based on inferred Response Time for Android users where direct collection of RT is missing. This is to recover from a bug where RT was not collected from Android users prior to build 26.

User facing

• DCCS scores updated in daily .csv provided to collaborators - on track for 6/1 completion

• item-level response times provided to NU for QA

• provide item-level response times persistent for users, prior to public release of data

• maintenance of computation in future scoring code

Support for myCog ‘grouped’ assessment

Planning

Implement solution to mitigate ‘Glue bug’ to unblock ICAR and future studies

User facing

• Analysts don’t have unpredictable columns (_double and _int) appearing in parquet, or NaNs or unexpected zero values in scores .csv

• define monitoring/validation tests

Scoring code operationalization

Infrastructure

• Automation of completion dashboard and .csv to refresh every 24hrs

• Create mapping of which version of scoring code is running by setting up release process for scoring code to tag to Docker container.

• optimize EC2 compute instance

• write back data completion state to Bridge

iOS support for MyCogMobile ‘grouped’ assessment

User facing

• Study launch in mid-July

• respond to bug fixes

none

Define data processing states for internal and external exposure. Researchers will be able to see assessment level data status of completed on device, data processing, and data ready for analysis. Internal tools can see additional states (validation fail, parquet complete etc.)

Planning

• Requirements Final requirements document for data states

• Implement writing to API and exposing states in UI

• persist scores completion state for Bridge - API complete

• provide status of data as ‘in progress’ or ‘ready for analysis’ in Researcher Portal UI

Define process and tools for more efficient schema validation

Planning

Work plan to prepare for upcoming schema refresh of core measures

Implementation of process and toolsDetailed adherence report visible in the Researcher Portal UI that shows each assessment completion status, skipped status, and completion timestamp

User facing

• Expand beta to UCSF and UCSD - completed

• provide status of data as ‘in progress’ or ‘ready for analysis’ in Researcher Portal UI

Jira Service Desk

Process

Mechanism for internal and external collaborators to file bugs in a template that propagates through to staging for triage

• respond to feedback

• setup cloning to Jira project space

Data re-processing of data ‘stuck’ in parquet queue

Issue resolution

• resolution of ~1% null value validation fails due to weather data

• resolution of UCSD failures

investigate taskdata validation fails due to null value and finalize plan for go-forwardData re-processing of data ‘stuck’ in parquet queue

Issue resolution

• resolution of ~1-2% ‘underscore file name’

Re-process data

Implement next phases of background recorder shutdown

User facing

• Live studies - completed

• Rollback App implementation with E2E QA plan for metadata/schema validation

• Future studies - remove from Researcher Portal UIPlan to rollback App implementation and metadata/schema validation

• Rollback App implementation with extensive QA

Implement logout capability

User facing

• enabled in debug mode

• QA started in Android and iOSQA complete in Android and iOS

• available in participant app UI

Create a way to expose/stage new assessments for specific studies

Infrastructure

Design complete for server implementation of study-level permissions

Implement UI/API to designate permissions

Alerting reqs for adherence

User facing

Validation of UI

Define criteria for onboarding new studies

Planning

• External/internal studies

• Understand timing

• Infrastructural and process needs

• Map to funding status

• Evaluate results for GA

Compute scores for DCCS (shape-color sorting) based on inferred Response Time for Android users where direct collection of RT is missing. This is to recover from a bug where RT was not collected from Android users prior to build 26.

User facing

• none

• provide item-level response times persistent for users, prior to public release of data

• maintenance of computation in future scoring code

Upgrade and unify build processes for production app

https://sagebionetworks.jira.com/l/cp/XnNugxp1

medium

TBD

TBD

Login/logout capability

Allow participant and preview accounts to logout and login so that data state is retained and cache i s properly cleared without deleting and reinstalling the app. Supports preview and ‘recycled’ phone scenarios

high

1TBD

August release 2023

Turn off background recorders

part 1: turn off capability for researchers to optionally turn on recorders and defalut all study configs to OFF

part 2: excise the implementation of the recorders on both Android and iOS

part 1 = low

part 2 = high because of QA

2

Part 1 june July 2023

Editable schedules

Allow changes to a schedule after a study has been launched

high

2

Post-renewal. Requires architectural overhaul. New studies can currently be manually constructed to have more flexibility. Existing studies will not be editable. New work will ensure that ALL new studies will automatically have more flexibility.

Spanish language

Provide app and assessments to run studies ALL in english or ALL in spanish

medium

2

earliest Fall 2023

Self-service account setup

Allow public users to onboard to Mobile Toolbox to explore, and to launch studies with a verified identity

high

1

target fall 2023

Self-service access controls

Allow Study Admins to invite users and have granular control over what team members can see and do with PII and study data

high

1

target fall 2023

Custom Survey Authoring

Researchers can collaborate and construct custom survey questions that can be delivered to participants as part of their schedule of activities

high

2

Deprioritized. Target beta in Q3/Q4

Detailed Adherence completion reporting

Study Coordinators can see the details of completion status and date for every assessment administered

medium

1

April 2023 - completed

Adherence Alerts page

Study Coordinators can view alerts when participants fall below adherence thresholds or other events

medium

2

Q2 2023

Schema refresh

Update the schemas of core assessments to optimize data processing

medium

2completed

post-renewal

Automated scoring

Scores are automatically processed on-device or on a daily basis to keep up with ongoing data collection

medium

1

V1 complete

Public website updates

Include suggested language for grant submissions, sample data, FAQs, About Us bios, more detailed assessment information

medium

2

Q3 2023

Customer support helpdesk

Ticketing and tracking system and knowledge base to scale up responses to issues reported by coordinators

high

2

Q3 2023

Product documentation

Update and publish product documentation

medium

3

July oost-renewal October 2023

Crashlytics tuning

Improve crash and log collection from the mobile App to more quickly characterize and respond to bugs.

medium

2

Q2 2023

Data samples

Provide data samples so potential users can demo the app and explore data output without having to launch a study

low

3

Q2 2023

Demographics upload UI

Study Coordinators can upload demographics metadata so it can be automatically incorporated into data processing and analysis

medium

3

TBD