sbrl/MarkovGrams
sbrl/MarkovGrams
1
0
Fork 0
Code Issues Pull requests Activity

Add Shakepeare's complete works

Browse source
This commit is contained in:
Starbeamrainbowlabs 2018-09-03 21:24:32 +01:00
parent 8f4a3f41bd
commit 83d27d2289
Signed by: sbrl
GPG key ID: 1BE5172E637709C2
2 changed files with 149692 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

149689
wordlists/Shakespeares-Works.txt Normal file
View file

File diff suppressed because it is too large Load diff

3
wordlists/download.sh
View file

@ -25,3 +25,6 @@ curl https://stardewids.com/ | xidel --data - --css "td.ts a" | sort >Stardew-Va
### Recipes Wikia ### ### Recipes Wikia ###
curl http://recipes.wikia.com/sitemap-newsitemapxml-index.xml | xidel --data - --css "loc" | grep -i NS_0 | xargs -n1 -I{} sh -c 'curl {} | xidel --data - --css "loc"' | sed -e 's/^.*\///g' -e 's/_/ /g' | python -c "import urllib, sys; print urllib.unquote(sys.argv[1] if len(sys.argv) > 1 else sys.stdin.read()[0:-1])" | sort >Dishes.txt curl http://recipes.wikia.com/sitemap-newsitemapxml-index.xml | xidel --data - --css "loc" | grep -i NS_0 | xargs -n1 -I{} sh -c 'curl {} | xidel --data - --css "loc"' | sed -e 's/^.*\///g' -e 's/_/ /g' | python -c "import urllib, sys; print urllib.unquote(sys.argv[1] if len(sys.argv) > 1 else sys.stdin.read()[0:-1])" | sort >Dishes.txt
### Shakespeare's Complete Works ###
curl https://www.gutenberg.org/files/100/100-0.txt >Shakespeares-Works.txt