Now that we are running in larger data centers with the power of Microsoft Azure and with hardware technology such as solid state storage (moving away from the limitations of rotating platters) we all want to take a deep breath and make a sigh of performance joy.
Unfortunately when you eliminate one bottleneck the data moves to the next. Additionally bottlenecks are not just hardware.
Consider a rock wall layered in a stream of water, you remove the rocks blocking the water, and the water rushes to the next barrier. The same concept applies to data.
If you are working with millions or hundreds of thousands of data records you might want to consider:
What are your favorite tips and tricks for performance?
Oh and as a last note .. there are customers processing 100,000s of data records a DAY with the Microsoft Dynamics platform. The power is incredible with a little love.