Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Note that HERE %iles are interpolated values, not necessarily observed in samples #897

Open
wants to merge 2 commits into
base: master
Choose a base branch
from

Conversation

Nate-Wessel
Copy link
Contributor

@Nate-Wessel Nate-Wessel commented Mar 5, 2024

I.e. HERE calculates percentiles with something like PostgreSQL's percentile_cont rather than percentile_disc as I had originally assumed. This means that except where the sample_size = 3 (for the median) or sample_size = 20 ( for the 85th), the percentile values are almost certain to be interpolated rather than actually observed in the sample.

This can be demonstrated by looking at records WHERE sample_size = 2

SELECT 
    min_spd,
    pct_50,
    max_spd
FROM here.ta_path
WHERE sample_size = 2
LIMIT 100

What this pull request accomplishes:

  • Notes a quirk in the HERE data

Issue(s) this solves:

  • adds to documentation

What, in particular, needs to reviewed:

  • facts

What needs to be done by a sysadmin after this PR is merged

NA

@Nate-Wessel Nate-Wessel requested a review from chmnata March 5, 2024 19:52
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants