Skip to content

Commit

Permalink
fix: should not check paper url
Browse files Browse the repository at this point in the history
gov.cn change url frequently
  • Loading branch information
NateScarlet committed Oct 25, 2023
1 parent 00f4564 commit 74303b4
Showing 1 changed file with 0 additions and 5 deletions.
5 changes: 0 additions & 5 deletions scripts/fetch.py
Original file line number Diff line number Diff line change
Expand Up @@ -138,11 +138,6 @@ def get_paper(url: str) -> str:
str: Extracted paper text.
"""

assert re.match(
r"https?://www.gov.cn/zhengce/(zhengceku|content)/\d{4}-\d{2}/\d{2}/content_\d+.htm",
url,
), "site changed, need human verify: %s" % (url,)

response = requests.get(url)
_raise_for_status_200(response)
response.encoding = "utf-8"
Expand Down

0 comments on commit 74303b4

Please sign in to comment.