Python Producer-Consumer Template
Template for producer-consumer automations using Robocorp -libraries
This template leverages the new Python framework, the libraries from to same project as well.
This template contains a working robot implementation that has the basic structure where the first part produces work items from an input and the second one consumes those newly created output work items.
The template tries to keep the amount of functional code at a minimum so you have less to clear out and replace with your own implementation, but some functional logic is needed to have the template working and guiding the key parts.
We recommended checking out the article "Using work items" before diving in.
Tasks
The robot is split into two tasks, meant to run as separate steps in Control Room. The first task generates (produces) data, and the second one reads (consumes) and processes that data.
The first task (the producer)
- Load the example Excel file from work item
- Split the Excel file into work items for the consumer
The second task (the consumer)
We recommended checking out the article "Work item exception handling" before diving in.
- Loop through all work items in the queue and access the payloads from the previous step
Local testing
For best experience to test the work items in this example we recommend using Robocorp Code -extensions for VS Code. With the Robocorp Code extension you can simply run and select the input work items to use, create inputs to simulate error cases, and so on.
Extending the template
The producer-consumer model is not limited to two steps, it can continue so that the consumer generates further work items for the next step and so on.
Here's how you can add a third step, let's say a reporter, which will collect inputs from the previous one (the consumer) and generate a simple report with the previously created data. But first, see below what you need to add extra:
The reporter
step code
And as you can see, we collect some "Order"
info from the previously created outputs, but we don't have yet such outputs created in the previous step (the consumer), so let's create them:
The magic happens in this single line added right before the item.done()
part: workitems.outputs.create(payload={"Order": f"{name} is complete"})
. This creates a new output for every processed input with an "Order"
field in the payload data. This is retrieved in the next step (reporter) through item.payload["Order"]
.
The reporter
task entry
All good on the code side, but we need now to make this new task visible and runnable right in our robot.yaml configuration. So add this under tasks:
:
Now you're good to go, just run the consumer again (so you'll have output items created), then run the newly introduced 3rd step called reporter.
๐ Now, go get'em
Start writing Python and remember that the AI/LLM's out there are getting really good and creating Python code specifically.
๐ Try out Robocorp ReMark ๐ฌ
For more information, do not forget to check out the following:
- Robocorp Documentation -site
- Portal for more examples
- Follow our main robocorp -repository as it is the main location where we developed the libraries and the framework.
Technical information
Last updated
9 April 2024License
Apache License 2.0Dependencies