You should first try out "responsibility centers" first. You can set this per user in "User setup". And only when this does not fulfill your requirement, then move on to Security Filters. "responsibility centers" should filter out most documents by the setup per user.
You can do more with Security Filters, and set more custom filters on records. But, be aware that this will affect performance.