2.2.3 - Avoid some mention edge cases

This commit is contained in:
Mispy 2014-04-28 10:56:48 -07:00
parent a836e00a87
commit 17ef359de2
3 changed files with 7 additions and 6 deletions

View file

@ -1,4 +1,4 @@
# twitter\_ebooks 2.2.2
# twitter\_ebooks 2.2.3
Rewrite of my twitter\_ebooks code. While the original was solely a tweeting Markov generator, this framework helps you build any kind of interactive twitterbot which responds to mentions/DMs.
@ -63,7 +63,7 @@ The underlying [tweetstream](https://github.com/tweetstream/tweetstream) and [tw
twitter\_ebooks comes with a syncing tool to download and then incrementally update a local json archive of a user's tweets.
``` zsh
➜ ebooks archive 0xabad1dea corpus/0xabad1dea.json
➜ ebooks archive 0xabad1dea corpus/0xabad1dea.json
Currently 20209 tweets for 0xabad1dea
Received 67 new tweets
```
@ -75,7 +75,7 @@ The first time you'll run this, it'll ask for auth details to connect with. Due
In order to use the included text modeling, you'll first need to preprocess your archive into a more efficient form:
``` zsh
➜ ebooks consume corpus/0xabad1dea.json
➜ ebooks consume corpus/0xabad1dea.json
Reading json corpus from corpus/0xabad1dea.json
Removing commented lines and sorting mentions
Segmenting text into sentences
@ -84,7 +84,7 @@ Ranking keywords
Corpus consumed to model/0xabad1dea.model
```
Notably, this works with both json tweet archives and plaintext files (based on file extension), so you can make a model out of any kind of text.
Notably, this works with both json tweet archives and plaintext files (based on file extension), so you can make a model out of any kind of text.
Text files use newlines and full stops to seperate statements.

View file

@ -103,7 +103,8 @@ module Ebooks
mless = ev[:text]
begin
ev.attrs[:entities][:user_mentions].reverse.each do |entity|
mless = mless[0...entity[:indices][0]] + mless[entity[:indices][1]..-1].strip
last = mless[entity[:indices][1]..-1]||''
mless = mless[0...entity[:indices][0]] + last.strip
end
rescue Exception
p ev.attrs[:entities][:user_mentions]

View file

@ -1,3 +1,3 @@
module Ebooks
VERSION = "2.2.2"
VERSION = "2.2.3"
end