Add: filter out invalid documents in load_all_documents function

all in one go