...
Mobile Toolbox has ONE cross-platform production app that is intended for partner developers to add a variety of assessment types. As the primary unified development team of Northwestern and Sage, we must commit that all releases depend on all participant facing app components functioning within the production app. A local or other environment may be a good pre-indicator of functionality or used as an interim step. However, it is ultimately irrelevant if components can function outside of the app (i.e. in a local dev or test environment or in a different version of the app), since fundamentally components must work within the production app to deliver the value of the platform to our users. Efficiencies can be gained by performing QA on new builds directly using the production app. Other reliability and efficiencies are gained by unifying maintenance and upgrade support in a single location. Aside from greatly needed resource optimization and efficiency, the two specific scenarios are addressed.
Scenarios that are addressed:
Reduce build dependency across teams: NU can generate as many builds as they want at whatever speed they want and quickly QA before sending to Sage for an integrated build.
Enables E2E test/staging environment: this environment can be setup with an E2E pipeline and scoring environment for comprehensive QA before committing a build to the release.
Capture production fails early in the process: Functions that appear to work in local environments are caught very early on in the Qy on in the QA process. Examples of these functions include orientation/rotation lock, swipe gestures, and archive/upload of data. All three of these functions have historically caused significant user experience issues.
The goal of this proposal to align the primary development teams and prioritize infrastructural work so that we can get to a reliable, automated process for publishing measure libraries and streamlining QA. We are seeking feedback on the feasibility of and timeline for this work. If there are resource or technical constraints we are unaware of, this proposal can be updated to reflect changes. This work has previously been agreed upon (still some details to work through), but was de-prioritized due the urgency of supporting new studies (ICAR/schema refresh and MyCogMobile).
There are legacy reasons (ex. support for the initial validation app from June 2020) for having multiple environments and test apps, but scalability, reliability, and test automation going forward requires infrastructural upgrades. To come up to current standards in June 2023 and move forward into our renewal period we have the following recommendations for primary and partner development teams:
...