Skip to content

get_webpage_structured_data

get_webpage_structured_data(url)

Description

Get webpage Structured Data that Google shows in search results.

Examples

Call or Deploy get_webpage_structured_data ?
Call get_webpage_structured_data directly

The easiest way to use bigfunctions

  • get_webpage_structured_data function is deployed in 39 public datasets for all of the 39 BigQuery regions.
  • It can be called by anyone. Just copy / paste examples below in your BigQuery console. It just works!
  • (You need to use the dataset in the same region as your datasets otherwise you may have a function not found error)

Public BigFunctions Datasets

Region Dataset
eu bigfunctions.eu
us bigfunctions.us
europe-west1 bigfunctions.europe_west1
asia-east1 bigfunctions.asia_east1
... ...
Deploy get_webpage_structured_data in your project

Why deploy?

  • You may prefer to deploy get_webpage_structured_data in your own project to build and manage your own catalog of functions.
  • This is particularly useful if you want to create private functions (for example calling your internal APIs).
  • Get started by reading the framework page

Deployment

get_webpage_structured_data function can be deployed with:

pip install bigfunctions
bigfun get get_webpage_structured_data
bigfun deploy get_webpage_structured_data

select bigfunctions.eu.get_webpage_structured_data("https://apps.apple.com/fr/app/nickel-compte-pour-tous/id1119225763")

select bigfunctions.us.get_webpage_structured_data("https://apps.apple.com/fr/app/nickel-compte-pour-tous/id1119225763")

select bigfunctions.europe_west1.get_webpage_structured_data("https://apps.apple.com/fr/app/nickel-compte-pour-tous/id1119225763")

+-----------------+
| structured_data |
+-----------------+
| {...}           |
+-----------------+

screenshot

Need help or Found a bug using get_webpage_structured_data?
Get help using get_webpage_structured_data

The community can help! Engage the conversation on Slack

We also provide professional suppport.

Report a bug about get_webpage_structured_data

If the function does not work as expected, please

  • report a bug so that it can be improved.
  • or open the discussion with the community on Slack.

We also provide professional suppport.

Use cases

A use case for the get_webpage_structured_data function is SEO analysis and monitoring.

Imagine you have a database of competitor websites or a list of your own web pages. You could use this function within BigQuery to:

  1. Extract structured data at scale: Periodically run a query that iterates through your list of URLs and calls get_webpage_structured_data for each one. This allows you to collect the structured data for a large number of pages efficiently.

  2. Identify missing or incorrect structured data: Analyze the returned JSON for specific schema types (e.g., Product, Article, LocalBusiness) to ensure your competitors or your own pages have correctly implemented structured data markup. This helps identify opportunities to improve search engine visibility.

  3. Track changes in structured data: By running the function regularly, you can monitor changes in structured data implementations over time. This could indicate updates to content, changes in SEO strategy, or technical issues.

  4. Competitive analysis: See what structured data your competitors are using. This can inform your own SEO strategy. For example, if competitors are using a specific schema type that you aren't, it might be worth investigating.

  5. Automated reporting: Build dashboards and reports in BigQuery to visualize structured data trends and identify areas for improvement.

Example Scenario:

Let's say you want to check if your competitors are using the Product schema correctly on their product pages. You have a table called competitor_products with a column product_url. You can use the get_webpage_structured_data function in a query like this:

SELECT
    competitor_products.product_url,
    bigfunctions.us.get_webpage_structured_data(competitor_products.product_url) AS structured_data
FROM
    `your_project.your_dataset.competitor_products`;

This query will return the structured data for each product URL. You can then further process the JSON within BigQuery to check for the presence and correctness of the Product schema, allowing you to identify competitors who are doing a better job with structured data and learn from their implementation.

Spread the word!

BigFunctions is fully open-source. Help make it a success by spreading the word!

Share on Add a on