>When a filter is set to a table with many records and the filter only includes a few records somewhere in the middle of the table, is there a way to prevent the long wait when you skip past the limits of the filter?

Make sure the filter exactly matches a key for an existing index tag. That way the filter is "Rushmore optimized".