Project

tweet_sanitizer

0.0
No release in over a year
tweet_sanitizersue445/tweet_sanitizerHomepageDocumentationSource CodeBug TrackerWiki
sanitize tweet
2005
2006
2007
2008
2009
2010
2011
2012
2013
2014
2015
2016
2017
2018
2019
2020
2021
2022
2023
2024
 Popularity
Downloads
9,632
Stars
0
Forks
0
Watchers
3
 Releases
Current version
0.2.1
Total releases
5
First release
2017-08-13
Latest release
2021-11-20
 Issues
Open Issues
0
Closed Issues
1
Total Issues
1
Issue Closure Rate
100%
 Pull Requests
Open Pull Requests
0
Closed Pull Requests
2
Merged Pull Requests
47
Pull Request Acceptance Rate
95%
 Development
Primary Language
Ruby
Licenses
MIT
Average date of last 50 commits
2022-07-21
Reverse Dependencies
0

 Dependencies

Development

coveralls
>= 0
dotenv
>= 0
pry-byebug
>= 0
rspec
~> 3.0
rspec-parameterized
>= 0
simplecov
>= 0
bundler
>= 1.15
rake
>= 10.0
unparser
>= 0.4.5

Runtime

twitter
>= 0
 Project Readme

TweetSanitizer

Gem Version Build Status Code Climate Coverage Status

This is extension of twitter. Sanitize Twitter::Tweet#text

Example

tweet = @client.status("https://twitter.com/github/status/866677968608927744")
tweet.text
#=> "Introducing GitHub Marketplace, a new place to browse and buy integrations using your GitHub account.… https://t.co/dK0Tmcmm72"
using TweetSanitizer::TwitterExtension

extended_tweet = @client.status("https://twitter.com/github/status/866677968608927744", tweet_mode: "extended")
extended_tweet.sanitized_text
#=> "Introducing GitHub Marketplace, a new place to browse and buy integrations using your GitHub account. https://github.com/blog/2359-introducing-github-marketplace-and-more-tools-to-customize-your-workflow"

Features

  • Expand urls in Twitter::Tweet#text (e.g. t.co url -> original url)
  • Remove media urls in Twitter::Tweet#text
  • Unescape special html characters in Twitter::Tweet#text (e.g. (&gt; &lt;) -> (> <))

Installation

Add this line to your application's Gemfile:

gem 'tweet_sanitizer'

And then execute:

$ bundle

Or install it yourself as:

$ gem install tweet_sanitizer

Usage

Case 1. Use TweetSanitizer::TwitterExtension and Twitter::Tweet#sanitized_text (Recommended)

using TweetSanitizer::TwitterExtension

extended_tweet = @client.status("https://twitter.com/github/status/866677968608927744", tweet_mode: "extended")
extended_tweet.sanitized_text

Case 2. Use TweetSanitizer.sanitize 

extended_tweet = @client.status("https://twitter.com/github/status/866677968608927744", tweet_mode: "extended")
TweetSanitizer.sanitize(extended_tweet)

⚠️ Note

When you get Twitter::Tweet instance, pass tweet_mode: "extended" option to methods. (e.g. Twitter::REST::Client#status, Twitter::REST::Client#search)

Because full_text attribute is returned when only tweet_mode=extended is passed to Twitter API

See following.

https://dev.twitter.com/overview/api/upcoming-changes-to-tweets

Options

Same to Twitter::Tweet#sanitized_text and TweetSanitizer.sanitize. (By default all are true)

  • use_retweeted_tweet : Whether use original retweeted tweet if exists
  • expand_url : Whether expand url in tweet (e.g. t.co url -> original url)
  • remove_media_url : Whether remove media url in tweet
  • unescape : Whether unescape in tweet (e.g. (&gt; &lt;) -> (> <))

Example

tweet = @client.status("https://twitter.com/github/status/900456141557080065", tweet_mode: "extended")

# all are false
tweet.sanitized_text(use_retweeted_tweet: false, expand_url: false, remove_media_url: false, unescape: false)
#=> "RT @GitHubEducation: Announcing two new GitHub Classroom features: Assignment Deadlines and Class Rosters: https://t.co/bNiJnlps5e https://…"

# Only use_retweeted_tweet is true
tweet.sanitized_text(use_retweeted_tweet: true, expand_url: false, remove_media_url: false, unescape: false)
#=> "Announcing two new GitHub Classroom features: Assignment Deadlines and Class Rosters: https://t.co/bNiJnlps5e https://t.co/C02G05tUvu"

# Only expand_url is true
tweet.sanitized_text(use_retweeted_tweet: false, expand_url: true, remove_media_url: false, unescape: false)
#=> "RT @GitHubEducation: Announcing two new GitHub Classroom features: Assignment Deadlines and Class Rosters: https://github.com/blog/2418-github-classroom-now-supports-deadlines-and-class-rosters https://…"

# Only remove_media_url is true
tweet.sanitized_text(use_retweeted_tweet: false, expand_url: false, remove_media_url: true, unescape: false)
#=> "RT @GitHubEducation: Announcing two new GitHub Classroom features: Assignment Deadlines and Class Rosters: https://t.co/bNiJnlps5e https://…"

# all are true (default)
tweet.sanitized_text
#=> "Announcing two new GitHub Classroom features: Assignment Deadlines and Class Rosters: https://github.com/blog/2418-github-classroom-now-supports-deadlines-and-class-rosters"

Development

cp .env.example .env
vi .env
./bin/console
[1] pry(main)> @client.status("https://twitter.com/sue445/status/896748477262082049", tweet_mode: "extended")
=> #<Twitter::Tweet id=896748477262082049>

Contributing

Bug reports and pull requests are welcome on GitHub at https://github.com/sue445/tweet_sanitizer.

License

The gem is available as open source under the terms of the MIT License.