Include robots.txt in UI and API for handling of web crawlers#2084

Merged

jjnesbitt merged 7 commits intomasterfrom ak-robots

Nov 25, 2024

+28-1

Commits on Nov 25, 2024

Include robots.txt in UI and API for handling of web crawlers

Aaron Kanzer
authored and
Aaron Kanzer
committed
include unit tesT

Aaron Kanzer
authored and
Aaron Kanzer
committed
whoops

Aaron Kanzer
authored and
Aaron Kanzer
committed
resolve tests

Aaron Kanzer
authored and
Aaron Kanzer
committed
Remove whitespace from robots.txt page
jjnesbitt
committed
Fix tests
jjnesbitt
committed
Fix linting
jjnesbitt
committed