Web scraper Python robot example

This robot is included in our downloadable example robots. You can also find the code at the example robots repository.

It is possible to implement robots using pure Python, without using Robot Framework. These robots are first-class citizens in Robocorp: they can be developed iteratively with our developer tools, and run and orchestrated in Robocorp Cloud, like any other robot. RPA Framework, our set of open-source libraries, provides APIs for both Robot Framework and Python.

This simple robot opens a web page, searches for a term, and takes a screenshot of the web page using the Rpa.Browser library.

Run this robot locally in Robocorp Lab

You can run this robot on your local machine using Robocorp Lab:

  1. Set up your development environment.
  2. Download the example robots.
  3. Open the python-robot example.
  4. Open the tasks.py file and run it.

Robot script (Python)

from RPA.Browser import Browser

browser = Browser()
url = "https://robocorp.com/docs/"
term = "python"
screenshot_filename = "output/screenshot.png"

def open_the_website(url: str):

def search_for(term: str):
    input_field = "css:input"
    browser.input_text(input_field, term)
    browser.press_keys(input_field, "ENTER")

def store_screenshot(filename: str):

# Define a main() function that calls the other functions in order:
def main():

# Call the main() function, checking that we are running as a stand-alone script:
if __name__ == "__main__":
  • Import the Browser library from the RPA.Browser package.
  • Initialize the browser and some variables.
  • Define the functions that implement the operations the robot is supposed to do.
  • Define the main function.
  • Call the main function.

Important: Always use try and finally to ensure that resources such as open browsers are closed even if some of the functions fail. This is similar to using [Teardown] in Robot Framework scripts. Read the Errors and Exceptions document on python.org for more information.


The robot.yaml file for the Python robot looks like this:

      - python
      - tasks.py

condaConfigFile: conda.yaml
artifactsDir: output
  - .gitignore
  - .
  - .

Note the command section:

  - python
  - tasks.py

In this case, we tell Python to run the tasks.py file. You can customize the command for your needs.

For comparison, the typical Robot Framework command looks like this:

  - python
  - -m
  - robot
  - --report
  - NONE
  - -d
  - output
  - --logtitle
  - Task log
  - tasks.robot

In this case, we tell Python to run the robot module (python -m robot) with arguments.