How to make our custom flow that will use the Akeneo jobs for batch processing to import products in Akeneo PIM?

[vivekbiztechcs]

We want to set an execution flow as below:

• We want to develop our custom import process using the Akeneo PIM standard package.
• Initially, we need to set the command that will fetch the supplier's products and store them to the Akeneo database(in a new separate table),
• Then we will need to set a custom command that will read the product data from a database,
• Then we need to process(do formatting of data that we can use in create products endpoint) the products to store in the Akeneo using endpoint,
• Then the processed products will be dispatched to the jobs(that can run asynchronously in the background using the supervisor) in batches like (Batches like 1 to 100, 101 to 200, 201 to 300, and so on)
• Then the dispatcher jobs will create the products in the Akeneo PIM system using the create products API endpoint.

Note:

• We have a large number of products to process around 1.5+ lacks.
• We need to set the import process using custom flow which can execute in the background using commands and jobs (asynchronously).

Help us with the code reference or any reference documentation by which we can set up the above development flow.
Also suggest us the setup method like using docker or manual setup which can help us to develop with fewer roadblocks.