Canova

Description

A tool focused simply on vectorizing raw data into usable vector formats across machine learning tools.

Example

• Convert the MNIST dataset from raw binary files to the svmLight text format.
• Convert raw text into the Metronome vector format
• Convert raw text into TF-IDF based vectors in a text vector format {svmLight, metronome, arff}
• Convert raw text into the word2vec in a text vector format {svmLight, metronome, arff}

Targeted Vectorization Engines

• MNIST to vectors
• Text to vectors
  • TF-IDF
  • Bag of Words
  • word2vec

Execution

Runs as both a local serial process and a MapReduce scale out process with no code changes.

Targetted Vector Formats

• svmLight
• libsvm
• Metronome
• ARFF

Built-In General Functionality

• Understands how to take general text and convert it into vectors with stock techniques such as kernel hashing and TF-IDF [TODO]