Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Google Search API] Scrape "Latest posts from..." section #2299

Open
marm123 opened this issue Jan 8, 2025 · 0 comments
Open

[Google Search API] Scrape "Latest posts from..." section #2299

marm123 opened this issue Jan 8, 2025 · 0 comments
Assignees
Labels
status: prioritized Prioritized work type: feature Something new to build

Comments

@marm123
Copy link

marm123 commented Jan 8, 2025

One of our Enterprise Customers reported that we're not scraping the "Latest posts from..." section visible in the Google output:

image

I also noticed that for some cases, we scrape this as part of the top_stories with only URLs available. We should probably move it to a separate section, and see if there is something more to scrape:

image

Public links: Playground - no "Latests posts from..." | Playground - "Latests posts from..." scraped in top_stories

Internal links: Intercom | Search Inspect - no "Latests posts from..." | Search Inspect - "Latests posts from..." scraped in top_stories

@marm123 marm123 added status: prioritized Prioritized work type: feature Something new to build labels Jan 8, 2025
@btaunt btaunt self-assigned this Jan 8, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
status: prioritized Prioritized work type: feature Something new to build
Projects
None yet
Development

No branches or pull requests

2 participants