No commit activity in last 3 years
No release in over 3 years
The test.ai image classification RPC server can listen for requests from this client in order to classify images and even use a Selenium client object to find elements in a webpage matching a certain label
2005
2006
2007
2008
2009
2010
2011
2012
2013
2014
2015
2016
2017
2018
2019
2020
2021
2022
2023
2024
 Dependencies

Development

~> 1.25
~> 5.13

Runtime

~> 1.25
 Project Readme

Test.ai Classifier - Ruby Client

The code in this directory defines a client library for use with the gRPC-based Test.ai classifier server.

Installation & Setup

gem install testai_classifier

Usage

This package exposes a ClassifierClient class, which you can instantiate with the host and port the classification server is running on:

require 'testai_classifier'

# ...

client = ClassifierClient.new(host, port)

You can use the client to attempt to match images to a semantic label:

# assume cart_img and menu_img are byte strings as delivered by
# File.read(filename).b

# define a mapping between ids and image data
data = {cart: cart_img, menu: menu_img}

# define which label we are looking to match
label = 'cart'

# attempt to match the images with the label
# confidence is from 0.0 to 1.0 -- any matches with lower than the specified
# confidence are not returned.
# allow_weaker_matches specifies whether to return matches that are above
# the confidence threshold but whose most confident match was a *different*
# label
res = client.classify_images(label, data, confidence=0.0, allow_weaker_matches=True)

# res looks like:
# {cart: {label: 'cart', confidence: 0.9, confidence_for_hint: 0.9},
#  menu: {label: 'menu', confidence: 0.9, confidence_for_hint: 0.2}}

You can also use it in conjunction with a Selenium Python client driver object, to find elements in a web page based on the label:

@driver.navigate.to "https://test.ai"
els = @client.find_elements_matching_label(@driver, 'twitter')
els[0].click
_(@driver.current_url).must_equal 'https://twitter.com/testdotai'

Development

  • make install - install deps (requires Bundler)
  • make protogen - generate python client helpers from .proto file (if this is done, the require for classifier_services_pb.rb must be updated to become relative).
  • make clean - reset generated files
  • make gem - build a gem from the project
  • make test - run test suite (also make unit-test and make se-test)
  • make publish - publish to rubygems