Skip to content

Commit f913d79

Browse files
authored
Update README.md
1 parent d870a41 commit f913d79

File tree

1 file changed

+15
-2
lines changed

1 file changed

+15
-2
lines changed

README.md

Lines changed: 15 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -29,6 +29,7 @@ Import the loaders
2929
```javascript
3030
import { PDFLoader } from '@langchain/community/document_loaders/fs/pdf'
3131
import { YoutubeLoader } from '@langchain/community/document_loaders/web/youtube'
32+
import { CharacterTextSplitter } from 'langchain/text_splitter'
3233
```
3334
3435
Create the loaders using the community methods:
@@ -37,12 +38,24 @@ In `docsFromYTVideo`:
3738
3839
```javascript
3940
const loader = YoutubeLoader.createFromUrl(video, { language: 'en', addVideoInfo: true, })
40-
return loader.load( new CharacterTextSplitter({ separator: ' ', chunkSize: 2500, chunkOverlap: 200, }) )
41+
const loadedDoc = await loader.load()
42+
const splitter = new CharacterTextSplitter({
43+
separator: ' ',
44+
chunkSize: 2500,
45+
chunkOverlap: 200,
46+
})
47+
return await splitter.splitDocuments(loadedDoc)
4148
```
4249
4350
In `docsFromPDF`:
4451
4552
```javascript
4653
const docsFromPDF = async () => { const loader = new PDFLoader('./xbox.pdf')
47-
return loader.load( new CharacterTextSplitter({ separator: ' ', chunkSize: 2500, chunkOverlap: 200, }) ) }
54+
const loadedDoc = await loader.load()
55+
const splitter = new CharacterTextSplitter({
56+
separator: '. ',
57+
chunkSize: 2500,
58+
chunkOverlap: 200,
59+
})
60+
return await splitter.splitDocuments(loadedDoc)
4861
```

0 commit comments

Comments
 (0)