Chunking 2M+ files a day for Code Search using Syntax Trees by kevinlu1248

📝 Blogs🍪 Chunking 2M+ files a day for Code Search using Syntax Trees Kevin Lu – July 3rd, 2023 Initializing any vector store requires chunking large documents for effective search. Why can’t we just embed entire files? Consider our main API endpoint (opens in a new tab)’s file: Imports Constants declarations Helper functions Business logic