Speed up this method for the common case.

No need to copy the list item by item, when no filtering is happening.