Contributions to Open Research

- Highlighting the work of SOTA reseachers & practitioners who publish code, models, app & notebooks (in some cases) for a paper
- ML Concepts explained in under a minute with accompanying notebook and notebook code walkthrough
- Discover and compare SOTA solutions for tasks with a few keystrokes/clicks
- Free APIs for tasks using SOTA models (with permissive licenses). Please use for evaluation only to avoid overwhelming servers
- demo apps hosted on TWC servers and/or on Hugging Face
- notebooks in Google colab
- Github repos with experiments that are work in progress
- Aperiodic newsletters on Ghost and Medium

Tasks solved using SOTA models

Image background removal - API available now
Video background removal
Classifying the dominant object in the foreground of an image
Detecting multiple objects within an image
Image Captioning
Video quality assessment
Learning image embeddings
Sentence embeddings for Semantic search, similarity, and clustering
Exploratory tasks

Image Background Removal

Current endpoint

for Image background removal. API usage illustrated in &

SOTA model for this task

InSPyReNet fork
- &
- Evaluate in Colab

Video Background Removal

Current endpoint

Notebook

SOTA model

InSPyReNet fork
- Evaluate in Colab

Foreground object classification

Current endpoint

Compare two model outputs (SimMIM & VIT base) in Colab
- Classifies input image into one of 1000 classes

SOTA model

SimMIM fork
- Evaluate in Colab

Detecting multiple objects within images

Current endpoint

Compare models through separate apps (Detic & OWL-ViT)
- . Detic Model
- OWL-ViT model

SOTA models

GRiT fork
- Evaluate in Colab

Image Captioning

OWL-ViT model

SOTA models

GRIT fork Evaluate in Colab

Video quality assessment

DOVER fork Evaluate in Colab

Self-supervised image representations

MAE fork Evaluate in Colab

Sentence embeddings

Tasks

Sentence Similarity Comparison app &
Semantic Search Comparison app &
Semantic Clustering Comparison app &

SOTA models

Exploratory tasks