VDP supports pipelines in ASYNC mode. In this mode, users trigger the pipelines by sending requests.
However, instead of returning the processed results immediately, the processed outputs will be loaded to the configured destination asynchronously.
This tutorial will demonstrate how to build an ASYNC pipeline using PostgreSQL database as the destination with the same Object Detection model.
#Prerequisites
In this tutorial, we'll use the same development environment below as in our previous tutorials.
Launch the VDP following [2/7] Launch VDP on your local machine and install required dependencies with
# move to the example directory for the VDP-101 ASYNC tutorial.cd /example/vdp-101/async# install dependencies.pip install -r requirement.txt
You can manage these dependencies with a Conda environment. For further information, we refer users to anaconda or miniconda.
#Create a new database in PostgreSQL
Before setting up an ASYNC pipeline, we need to set up a database for loading our pipeline outputs.
Here, let's start a PostgreSQL instance with the official Docker image and create the default database named tutorial
# Start a postgres instancedocker run -p 5432:5432 --name vdp-postgres -e POSTGRES_USER=postgres -e POSTGRES_PASSWORD=password -e POSTGRES_DB=tutorial -d postgres
In which POSTGRES_USER is used in conjunction with POSTGRES_PASSWORD to set a user and its password.
You can login in and check if tutorial is successfully created by checking if it is on the list.
# Log into Postgres and connect to the tutorial database.psql -h localhost -p 5432 -d tutorial -U postgres
↓↓↓ When you list all the databases, you should see a database named tutorial in the table below ↓↓↓
# list all databasestutorial=# \l List of databases Name | Owner | Encoding | Collate | Ctype | Access privileges-----------+----------+----------+------------+------------+----------------------- postgres | postgres | UTF8 | en_US.utf8 | en_US.utf8 | template0 | postgres | UTF8 | en_US.utf8 | en_US.utf8 | =c/postgres + | | | | | postgres=CTc/postgres template1 | postgres | UTF8 | en_US.utf8 | en_US.utf8 | =c/postgres + | | | | | postgres=CTc/postgres tutorial | postgres | UTF8 | en_US.utf8 | en_US.utf8 |(4 rows)
Now, we are ready to create our first ASYNC pipeline on VDP.
#Create an ASYNC pipeline
Open your local VDP console (http://localhost:3000), and click Add new pipeline. To set up an ASYNC pipeline for this tutorial,
- Source: select
Asyncfor Pipeline mode and selectHTTPfor Source type. - Model Instance: select
yolov7/v1.0-cpuunder Select an existing online model instance - Destination: set up a new destination to the Postgres database we just created (see the screenshot below). Host should be your local IP address, while Port, Username, Password and DB Name are set according to the launched postgres instance.
- Pipeline: set ID to
vdp-101-async.
↓↓↓ Check if the pipeline is activated on the Pipeline page ↓↓↓
Suppose you see a green light in front of the vdp-101-async pipeline, Voilà ! You have just set up an ASYNC pipeline.
#Trigger the ASYNC pipeline
Now would like to trigger the ASYNC pipeline we just created by running the script below.
# Trigger the ASYNC pipeline `vdp-101-async`# --api-gateway-url=< VDP API base URL ># --pipeline-id=< Pipeline ID indicates the pipeline to trigger># --framerate=< Frame rate of the video file, default is 30 ># --mapping-file=< File that stores the mapping indices for each processed image, default is 'data-mapping-indices.txt' >python trigger.py --api-gateway-url=http://localhost:8080 --pipeline-id=vdp-101-async --framerate=30 --mapping-file=data-mapping-indices.txt
This script first downloads a video cows_dornick.mp4 to the root folder, extracts image frames from the video file, and saves these image frames to the inputs folder. Once the extraction is completed, the script triggers the pipeline with image frame payload using HTTP Multipart POST Requests.
The pipeline responds with the indices (corresponding to each image), which are ultimately saved to an output file data-mapping-indices.txt under the async fold by default.
Unlike the responses in the SYNC mode, the ASYNC pipeline only responds with data_mapping_indices for each uploaded data.
{ "data_mapping_indices": ["01GDR4ZW7W4T2H2G8MK79Y49PG"], "model_instance_outputs": []}
After All the images are processed by the pipeline, you can check the indices using the command below:
# Preview the mapping indice filecat data-mapping-indices.txt
#Retrieve and visualise pipeline trigger results from database
After the vdp-101-async pipeline has processed all the images for the object detection task, we can fetch all the corresponding inference result from the database by mapping with the trigger operation IDs in the data-mapping-indices.txt.
Run the process.py script to fetch the pipeline detection outputs from the database, visualise the fetched detections on the corresponding input image and save to the outputs folder.
When setting --pq-host, users may need to indicate with actual IP address instead of localhost to access the Postgres database running in a docker container.
# Fetch and visualise the results from the database# --pq-host=< database host ># --pq-port=< database port ># --pq-database=< database name ># --pq-username=< database username ># --pq-password=< database password ># --output-filename=< output image directory, default is set to 'output.mp4' ># --framerate=< frame rate of the video file, default is set to 30 >$ python process.py --pq-host=< database host > --pq-port=5432 --pq-database=tutorial --pq-username=postgres --pq-password=password --output-filename=output.mp4 --framerate=30
Voilà ! Once everything is processed, you should find a video file output.mp4 (the same as the youtube video below) created from images in the outputs folder with all the images drawn with detected results from triggering the pipeline.
#Conclusion
In this tutorial, you've built an ASYNC Object Detection pipeline using VDP to process a video and send the analysis result to a PostgreSQL database.
If you enjoyed VDP, we're building a fully managed service for VDP - Instill Cloud (Alpha):
- Painless setup
- Maintenance-free infrastructure
- Start for free, pay as you grow
We also invite you to join our Discord community to share your use cases and showcase your work with Data/AI practitioners.
↓↓↓ VDP 101 - Get familiar with the basics ↓↓↓
