You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
This repository was archived by the owner on Mar 31, 2022. It is now read-only.
Thanks for the cool repo. Have everything working with custom models and would like to read multiple lines from 'example.txt' and generate max tokens for each pair of title/content lines and/or for each line and save to 'sample.txt'
Currently only reading lines 1 and 2 then generating max tokens and saving to 'sample.txt'
Generic format of 'example.txt' :
This is line 1 with title text.
This is line 2 with content text.
This is line 3 with new title text.
This is line 4 with new content text.
etc.
Have tried <|startoftext|> , blank lines etc. but only reads lines 1 and 2 then returns them followed by the max tokens.
Is there an example or special format to use?
Thanks for the cool repo. Have everything working with custom models and would like to read multiple lines from 'example.txt' and generate max tokens for each pair of title/content lines and/or for each line and save to 'sample.txt'
Currently only reading lines 1 and 2 then generating max tokens and saving to 'sample.txt'
python3 ArticleGenerator.py -f example.txt -o sample.txt -n 1
Generic format of 'example.txt' :
This is line 1 with title text.
This is line 2 with content text.
This is line 3 with new title text.
This is line 4 with new content text.
etc.
Have tried <|startoftext|> , blank lines etc. but only reads lines 1 and 2 then returns them followed by the max tokens.
Is there an example or special format to use?
Cheers