Handle, process and make HTTP request for huge data using ASP.NET Core

I have come up with a scenario and need some suggestions from you guys. The scenario is as below:

1. I'm going to have a table (inside a SQL Server database) which will be populated from two different sources: a) From an API b) From a web application (bulk and simple insert) and the population will be around of 10 million per month (I have ASP.NET Core Web App and API service to complete this task).

2. I need to process each of the inserted row and to send each of them solely to another system using API call My problem comes here - I have ASP.NET Core in my hand and I don't know what will be the best strategy to complete this task.

Please help me out. Thanks in advance.

https://stackoverflow.com/questions/66558642/handle-process-and-make-http-request-for-huge-data-using-asp-net-core March 10, 2021 at 01:00PM