This document is an attempt to capture how special values like None/NULL/NA/NaN/Inf/-Inf are handled in PLFM and across different clients as of today.
...
| Client | Empty value | NULL | None | NA | NaN | Inf | -Inf | Date |
|---|
| curl (repo-201) |
Empty list |
| | Status |
|---|
| |
|---|
| colour | Grey |
|---|
| title | Not applicable |
|---|
|
| | Status |
|---|
| |
|---|
| colour | Grey |
|---|
| title | Not applicable |
|---|
|
|
|
"Infinity" or "+Infinity" |
"-Infinity" | 10/19/2017 |
| web client (201) |
|
| | Status |
|---|
| |
|---|
| colour | Grey |
|---|
| title | Not applicable |
|---|
|
| | Status |
|---|
| |
|---|
| colour | Grey |
|---|
| title | Not applicable |
|---|
|
|
|
"Infinity" or "+Infinity" |
"-Infinity" | 10/20/2017 |
| python (synapseclient_1.7.2) | | Status |
|---|
| |
|---|
| colour | Grey |
|---|
| title | Not applicable |
|---|
|
| | Status |
|---|
| |
|---|
| colour | Grey |
|---|
| title | Not applicable |
|---|
|
| | | Status |
|---|
| |
|---|
| colour | Grey |
|---|
| title | Not applicable |
|---|
|
|
|
|
| 10/20/2017 |
| old r client | | Status |
|---|
| |
|---|
| colour | Grey |
|---|
| title | Not applicable |
|---|
|
| | | Status |
|---|
| |
|---|
| colour | Grey |
|---|
| title | Not applicable |
|---|
|
| | | | | 10/23/2017 |
| synapser | | Status |
|---|
| |
|---|
| colour | Grey |
|---|
| title | Not applicable |
|---|
|
| | | Status |
|---|
| |
|---|
| colour | Grey |
|---|
| title | Not applicable |
|---|
|
|
Becomes "None" |
|
|
| 10/23/2017 |
...
| Client | Empty Value | NULL | None | NA | NaN | Inf | -Inf | Date |
|---|
| curl (repo-201) |
|
|
|
|
|
|
|
|
| web client (201) |
Ignore empty rows | | | Status |
|---|
| |
|---|
| colour | Grey |
|---|
| title | Not applicable |
|---|
|
| | Status |
|---|
| |
|---|
| colour | Grey |
|---|
| title | Not applicable |
|---|
|
|
|
When query, returns "Infinity" |
When retrieved, returns "-Infinity" | 10/20/2017 |
| python (synapseclient_1.7.2) |
Can be uploaded from csv, cannot be read from Pandas | | Status |
|---|
| |
|---|
| colour | Grey |
|---|
| title | Not applicable |
|---|
|
|
Lost in Pandas for row with only None, and becomes NaN in float column | | Status |
|---|
| |
|---|
| colour | Grey |
|---|
| title | Not applicable |
|---|
|
|
Pandas writes NaN as empty values to csv, but can read NaN from csv |
float inf turns into "Infinity" |
float --inf turns into "-Infinity" | 10/20/2017 |
| old r client | | Status |
|---|
| |
|---|
| colour | Grey |
|---|
| title | Not applicable |
|---|
|
| | Status |
|---|
| |
|---|
| colour | Grey |
|---|
| title | Not applicable |
|---|
|
| | Status |
|---|
| |
|---|
| colour | Grey |
|---|
| title | Not applicable |
|---|
|
|
|
|
|
| 10/23/2017 |
| synapser | | Status |
|---|
| |
|---|
| colour | Grey |
|---|
| title | Not applicable |
|---|
|
| | Status |
|---|
| |
|---|
| colour | Grey |
|---|
| title | Not applicable |
|---|
|
| | Status |
|---|
| |
|---|
| colour | Grey |
|---|
| title | Not applicable |
|---|
|
| | Status |
|---|
| |
|---|
| colour | RedYellow |
|---|
| title | update |
|---|
|
| Red
| update | Written to csv as "NA"
Cannot save a csv that contains 'NA'. However, 'NA' in r data.frame made the round trip. | | Status |
|---|
| |
|---|
| colour | YellowGreen |
|---|
| title | update |
|---|
|
When read into data.frame, each unique value becomes a column. |
| | Status |
|---|
| |
|---|
| colour | YellowGreen |
|---|
| title | update |
|---|
|
When read into data.frame, each unique value becomes a column. | 10/2331/2017 |
Related Jira Tickets
...
