Add FAISS indexing utilities and enhance text processing functions for improved chunking and validation

447c09c