Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Test against manual outputs #774

Open
mvmaltitz opened this issue Jan 15, 2025 · 7 comments
Open

Test against manual outputs #774

mvmaltitz opened this issue Jan 15, 2025 · 7 comments
Assignees
@mvmaltitz

Comments

@mvmaltitz
Copy link
Collaborator

mvmaltitz commented Jan 15, 2025 •
edited
Loading

Test the plug-in results against the manual output results.

Open the results side by side

Manual outputs can be found here:
https://drive.google.com/drive/folders/19Xad2ZtLa6VJ5iJKo-i2AH92zb8Mawiy
@mvmaltitz mvmaltitz assigned timlinux and mvmaltitz and unassigned timlinux Jan 15, 2025
@mvmaltitz
Copy link
Collaborator Author

mvmaltitz commented Jan 17, 2025 •
edited
Loading

Geest Output Comparison
Date 17 Jan 2025
Tester Michelle von Maltitz

Result Key

🟢 = Pass / Output as expected
🟡 = Output received but not what was expected / Process failed one or more times before pass
🔴 = Fail / Could not process
⚠️ = Error / Crash

Contextual 🟢

Workspace Discrimination

Testing Input Value:

Image

Manual Output Plugin Output Status
Output Value 4.19 4.19 🟢
Image Image Image 🟢

Regulatory Frameworks

Testing Input Value:

Image

Manual Output Plugin Output Status
Output Value 3.5 3.5 🟢
Image Image Image 🟢

Financial Inclusion

Testing Input Value:

Image

Manual Output Plugin Output Status
Output Value 3.75 3.75 🟢
Image Image Image 🟢

Contextual Aggregate

Testing Input Value:

Image

Manual Output Plugin Output Status
Output Value 3.813371 3.813331 🟢
Image Image Image 🟢

@mvmaltitz
Copy link
Collaborator Author

mvmaltitz commented Jan 17, 2025 •
edited
Loading

Accessibility 🟢

⚠️ QGIS crashed and closed when I tried to run Accessibility

Image

Image

Woman's Travel Patterns

Testing Inputs:

Image

Manual Output Plugin Output Status
Kindergarten Image Image 🟢
Schools Image Image 🟢
Groceries Image Image 🟢
Pharmacies Image Image 🟢
Green Spaces Image Image 🟢
WTP Image Image 🟢

Public Transport

Testing Inputs:

Image

Manual Output Plugin Output Status
Image Image 🟢

Health Facilities

Testing Inputs:

Image

Manual Output Plugin Output Status
Image Image 🟢

Education and Training Facilities

Testing Inputs:

Image

Manual Output Plugin Output Status
Image Image 🟢

Financial Facilities

Testing Inputs:

Image

Manual Output Plugin Output Status
Image Image 🟢

Accessibility Aggregate

Testing Input:

Image

Manual Output Plugin Output Status
Image Image 🟢

Conclusion

The Accessibility plug-in outputs are different from the manual outputs, but they are correct to the inputs we received for St Lucia. It appears that different inputs were used for the manual outputs and the plug-in outputs

@mvmaltitz
Copy link
Collaborator Author

mvmaltitz commented Jan 17, 2025 •
edited
Loading

Place Characterisation

Active Transport

Testing Inputs:

Image

Manual Output Plugin Output Status
Street crossing No data Image 🟢
Cycle paths No data Image 🟢
Footpaths No data Image 🟢
Block layout No data Image 🟢
AT Image Image 🟢

Note: The layers are correct according to the input data

Safety

Testing Inputs:

Image

Manual Output Plugin Output Status
No input Image 🟢

Testing Inputs:

Image

Manual Output Plugin Output Status
Image Image 🟢

FCV

Testing Inputs:

Image

Manual Output Plugin Output Status
Image Image 🟢

Education

Image

Testing Inputs:

Manual Output Plugin Output Status
4 4 🟢
Image Image 🟢

Testing input:

Image

Manual Output Plugin Output Status
No data Image 🔴

Digital Inclusion

Testing Inputs:

Image

Manual Output Plugin Output Status
3.9 3.9 🟢
Image Image 🟢

Testing input:

Image

Manual Output Plugin Output Status
No data Image 🔴

Environmental Hazards

Testing Inputs:

Image

Manual Output Plugin Output Status
Fire Hazards No data Image 🟢
Flood Hazards No data Image 🟢
Landslide No data Image 🟢
Tropical Cyclone No data Image 🟢
Drought No data Image 🟢
ENV Image Image 🟢

Note: The layers are correct according to the input data

Water Sanitation

Testing Inputs:

Image

Manual Output Plugin Output Status
Image Image 🟢

Aggregation

Testing inputs:
Image

Manual Output Plugin Output Status
Image Image 🟡

@timlinux
Copy link
Contributor

@mvmaltitz this is great work! Could you please share complete error messages when you get issues?

Either zip and attach your complete log file:

Image

Or just try to get the error for the particular indicator that you are working with:

Image

@mvmaltitz
Copy link
Collaborator Author

@timlinux
I "ran all" and everything passed.

Image

@mvmaltitz
Copy link
Collaborator Author

@timlinux There is an error with education and digital inclusion when classifying polygons into classes

Education

Image

Key Value
analysis_mode use_classify_polygon_into_classes
classify_polygon_into_classes_layer_crs EPSG:32626
classify_polygon_into_classes_layer_id fake_Education_percent_cbe9a335_a051_48f4_87cd_3ca617c934c7
classify_polygon_into_classes_layer_name fake_Education_percent
classify_polygon_into_classes_layer_provider_type ogr
classify_polygon_into_classes_layer_source /home/michelle/Documents/Projects/WorldBank/Testing/Input_Layers/StLucia/Place Characterization/Education/fake_Education_percent.shp
classify_polygon_into_classes_layer_wkb_type MultiPolygon
classify_polygon_into_classes_selected_field None
classify_polygon_into_classes_shapefile
default_factor_weighting 1.0
default_multi_buffer_distances 0,0,0
default_single_buffer_distance 0
description
error Failed to process use_classify_polygon_into_classes: ''
error_file /home/michelle/Documents/Projects/WorldBank/Testing/Plugin_Output/StLucia/place_characterization/education/education/error.txt
execution_end_time
execution_start_time 2025-01-24T18:17:34.679873
factor_weighting 1.0
guid 9e223653-de27-47fb-a021-95af195e2e6d
id Education
index_score 0
indicator percentage of the labor force comprising women with university degrees
output_filename EDU_output
result use_classify_polygon_into_classes Workflow Error
result_file
use_classify_polygon_into_classes 1
use_classify_safety_polygon_into_classes 0
use_csv_to_point_layer 0
use_environmental_hazards 0
use_index_score 1
use_multi_buffer_point 0
use_nighttime_lights 0
use_point_per_cell 0
use_polygon_per_cell 0
use_polyline_per_cell 0
use_single_buffer_point 0
use_street_lights 0

Digital Inclusion

Image

Key Value
analysis_mode use_classify_polygon_into_classes
classify_polygon_into_classes_layer_crs EPSG:32626
classify_polygon_into_classes_layer_id fake_DIG_percent_21fe8524_3cae_4cc1_90e1_94ae4d54b3f5
classify_polygon_into_classes_layer_name fake_DIG_percent
classify_polygon_into_classes_layer_provider_type ogr
classify_polygon_into_classes_layer_source /home/michelle/Documents/Projects/WorldBank/Testing/Input_Layers/StLucia/Place Characterization/DigitalInclusion/fake_DIG_percent.shp
classify_polygon_into_classes_layer_wkb_type MultiPolygon
classify_polygon_into_classes_selected_field None
classify_polygon_into_classes_shapefile
default_factor_weighting 1.0
default_multi_buffer_distances 0,0,0
default_single_buffer_distance 0
description
error Failed to process use_classify_polygon_into_classes: ''
error_file /home/michelle/Documents/Projects/WorldBank/Testing/Plugin_Output/StLucia/place_characterization/digital_inclusion/digital_inclusion/error.txt
execution_end_time
execution_start_time 2025-01-24T18:17:35.532517
factor_weighting 1.0
guid 0477bc49-8667-41e6-93df-45e35203d442
id Digital_Inclusion
index_score 0
indicator Individuals using the Internet (% of population)
output_filename DIG_output
result use_classify_polygon_into_classes Workflow Error
result_file
use_classify_polygon_into_classes 1
use_classify_safety_polygon_into_classes 0
use_csv_to_point_layer 0
use_environmental_hazards 0
use_index_score 1
use_multi_buffer_point 0
use_nighttime_lights 0
use_point_per_cell 0
use_polygon_per_cell 0
use_polyline_per_cell 0
use_single_buffer_point 0
use_street_lights 0

@mvmaltitz
Copy link
Collaborator Author

@timlinux
Water sanitation is working as expected

Image

Image

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@mvmaltitz mvmaltitz

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@timlinux @mvmaltitz