Share
Report
21I’m using MCP to analyze sales data (e.g., total sales for 2025, Q1 sales, and comparisons with current data).
To handle large datasets, I added instructions in the Overview section to:
- Fetch records in batches (e.g., 1500 at a time)
- Continue automatically for all batches
- Aggregate totals across batches
Problem:
- First batch works correctly
- Copilot asks to continue instead of proceeding automatically
- Next batch often fails with “too much data”
- Results are incomplete and inconsistant
Question:
- What is the recommended approach for large datasets?
- Does MCP support pagination/aggregation via Overview instructions?
- How can we ensure automatic batch processing without prompts?
- Should this be handled outside MCP (e.g., APIs or pre-aggregated data), and if so, can we process/aggregate the data externally and then load or expose the summarized data back into MCP for querying? If yes, how to do it?
Categories:
I have the same question (0)
All responses (
Answers (
