Skip to content
Menu

Free tutorial

Advanced API Web Scraping in UiPath

When we do web scraping, we can take advantage of hidden APIs. For example, many companies load JSON or XML from their backend to their website via API…

Anders Jensen Automation & AI Instructor

Intro

When we do web scraping, we can take advantage of hidden APIs. For example, many companies load JSON or XML from their backend to their website via API calls. In this use case, we'll find the hidden APIs and use the information in them.

Learning Objectives

  • Using exposed API's to scrape the web with UiPath
  • How to do API calls/HTTP requests
  • Interpret the results
    • JSON parsing
    • Advanced JSON parsing

Description

  • Download the Excel data file
  • For each of the players on the sheet "3. Hidden APIs" get all their stats from nhl.com

Hints

  • Navigate to https://www.nhl.com/player and do a search for e.g. Sidney Crosby
  • Open the Developer Tools (F12)
  • Refresh the page and look at Network
  • Find the API call with the player stats (look at the responses)
  • Use that endpoint URL to create HTTP Requests in UiPath and interpret the result with JSON parsing

Video Guide

More tutorials

  • UiPath

    UiPath lessons and courses: beginner series, complete use cases, job interview cases, and advanced topics.

    Read more →
  • Drop Down Menus in UiPath (Find Children & Select Item)

    Free tutorial from andersjensenorg: Drop Down Menus in UiPath (Find Children & Select Item). Video walkthrough, exercise files, hints, and solutions.

    Read more →
  • For Each Loops in UiPath

    This full video tutorial shows, how to use For Each Loops in UiPath. Follow me on Twitter and learn RPA

    Read more →