file view performance is slow and made slower by facets

Description

The CSBC portal is backed (mostly) by file views.

The largest of these is the “All Data Files” view [here|syn9630847], which references ~220K files. Assuming the index is already built, it takes ~7seconds for this table to be displayed and an additional ~20seconds for the facets to be displayed. Even the 7 seconds is really too slow.

In contrast, loading a static table version “All Data Files (static table)” [here|syn21346411] is essentially instantaneous (< 1 or 2 seconds). I created this table by exporting the above file view to a TSV, importing the TSV to create a table, and manually copying the schema from the file view to the table.

The dynamic update of file views is nice, particularly as we debug the portals. But, eventually, portal content should change infrequently (e.g., monthly). Further, tables give us an easier way to include large text (in particular, without having to involve the platform team to flag columns as supporting long text).

I’m favoring porting CSBC portal file/folder views to static tables for these reasons. Am I missing something? Does anyone disagree? ? ? ? ? ?

Environment

None

Assignee

Ryan Luce

Reporter

Brian White

Labels

None

Validator

Brian White

Development Area

Data Curation / Metadata

Release Version History

None

Sprint

Priority

Major
Configure