ZeroModels

📖 Introduction

ZeroModels is a collection of pretrained models built entirely in Keras 3. It spans a broad range of tasks, including image classification, object detection, segmentation, monocular depth estimation, feature extraction, vision-language modeling (VLMs), speech recognition, speech-aware language modeling, text encoding and masked language modeling, sentence embeddings, large language models (LLMs), text-to-text encoder-decoder modeling, multimodal vision-language generation, text-to-image diffusion, and more.

⚡ Installation

From PyPI (recommended)

pip install -U zeromodels

From Source

pip install -U git+https://github.com/IMvision12/ZeroModels

📑 Documentation

ZeroModels Documentation

Detailed guides are available for all supported tasks, with architecture notes, usage examples, pretrained weights, and real model outputs.

Classification backbones share a single documentation page, while other model families have dedicated pages.

Documentation sources are also available in docs/.

💬 Sentence Transformers Models (sentence_transformers)

All 13 checkpoints below have pre-converted Keras weights under the zeromodels Hugging Face organization. Use ZMSentenceTransformer and ZMSentenceTransformerTokenizer from zeromodels.sentence_transformers for sentence similarity, semantic search, or clustering.

🏷️ Model Name	📜 Reference Paper	📦 Source of Weights
all-mpnet-base-v2	Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks	sentence-transformers
multi-qa-mpnet-base-dot-v1	Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks	sentence-transformers
all-distilroberta-v1	Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks	sentence-transformers
all-MiniLM-L12-v2	Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks	sentence-transformers
multi-qa-distilbert-cos-v1	Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks	sentence-transformers
all-MiniLM-L6-v2	Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks	sentence-transformers
multi-qa-MiniLM-L6-cos-v1	Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks	sentence-transformers
paraphrase-multilingual-mpnet-base-v2	Making Monolingual Sentence Embeddings Multilingual using Knowledge Distillation	sentence-transformers
paraphrase-albert-small-v2	Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks	sentence-transformers
paraphrase-multilingual-MiniLM-L12-v2	Making Monolingual Sentence Embeddings Multilingual using Knowledge Distillation	sentence-transformers
paraphrase-MiniLM-L3-v2	Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks	sentence-transformers
distiluse-base-multilingual-cased-v1	Making Monolingual Sentence Embeddings Multilingual using Knowledge Distillation	sentence-transformers
distiluse-base-multilingual-cased-v2	Making Monolingual Sentence Embeddings Multilingual using Knowledge Distillation	sentence-transformers

📑 Models

📝 Text Models

• Text Encoders (text → embeddings, masked LM, classification)

  🏷️ Model Name	📜 Reference Paper	📦 Source of Weights
  BERT	BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding	transformers
  ModernBERT	Smarter, Better, Faster, Longer: A Modern Bidirectional Encoder	transformers
  ELECTRA	ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators	transformers
  RoBERTa	RoBERTa: A Robustly Optimized BERT Pretraining Approach	transformers
  XLM-RoBERTa	Unsupervised Cross-lingual Representation Learning at Scale	transformers
  DeBERTa	DeBERTa: Decoding-enhanced BERT with Disentangled Attention	transformers
  DeBERTa-v2	DeBERTa: Decoding-enhanced BERT with Disentangled Attention	transformers
  DeBERTa-v3	DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharing	transformers
  MPNet	MPNet: Masked and Permuted Pre-training for Language Understanding	transformers
  T5	Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer	transformers
  BART	BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension	transformers

• Text LLMs (text → text)

  🏷️ Model Name	📜 Reference Paper	📦 Source of Weights
  Qwen2	Qwen2 Technical Report	transformers
  Qwen2-MoE	Qwen2 Technical Report	transformers
  Qwen3	Qwen3 Technical Report	transformers
  Qwen3-MoE	Qwen3 Technical Report	transformers
  Qwen3.5	Qwen3 Technical Report	transformers
  Qwen3-Next	Qwen3 Technical Report	transformers
  GPT-OSS	gpt-oss-120b & gpt-oss-20b Model Card	transformers
  GPT	Improving Language Understanding by Generative Pre-Training	transformers
  GPT-2	Language Models are Unsupervised Multitask Learners	transformers
  Llama 2	Llama 2: Open Foundation and Fine-Tuned Chat Models	transformers (gated)
  Llama 3	The Llama 3 Herd of Models	transformers (gated)
  Llama 4	meta-llama/Llama-4-Scout-17B-16E	transformers (gated)
  Mistral	Mistral 7B	transformers (gated)
  Mixtral	Mixtral of Experts	transformers (gated)
  DeepSeek-V2	DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Model	transformers
  DeepSeek-V3	DeepSeek-V3 Technical Report	transformers
  DeepSeek-V4	DeepSeek-V4 Technical Report	transformers
  Gemma	Gemma: Open Models Based on Gemini Research and Technology	transformers (gated)
  Gemma 2	Gemma 2: Improving Open Language Models at a Practical Size	transformers (gated)
  MiniMax-Text-01	MiniMax-01: Scaling Foundation Models with Lightning Attention	transformers
  MiniMax-M2	MiniMaxAI/MiniMax-M2	transformers
  GLM-4 (GLM-4-9B)	ChatGLM: A Family of Large Language Models from GLM-130B to GLM-4	transformers
  GLM-4-0414	THUDM/GLM-4-9B-0414	transformers
  GLM-4.5 / GLM-4.6 (MoE)	GLM-4.5: Agentic, Reasoning, and Coding (ARC) Foundation Models	transformers
  GLM-4.7-Flash (MoE Lite)	zai-org/GLM-4.7-Flash	transformers
  GLM-5 / GLM-5.1 / GLM-5.2 (MoE)	GLM-5 Technical Report	transformers

👁️ Vision Models

• Backbones

  🏷️ Model Name	📜 Reference Paper	📦 Source of Weights
  BEiT	BEiT: BERT Pre-Training of Image Transformers	transformers
  CaiT	Going deeper with Image Transformers	timm
  ConvMixer	Patches Are All You Need?	timm
  ConvNeXt	A ConvNet for the 2020s	timm
  ConvNeXt V2	ConvNeXt V2: Co-designing and Scaling ConvNets with Masked Autoencoders	timm
  DeiT	Training data-efficient image transformers & distillation through attention	timm
  DenseNet	Densely Connected Convolutional Networks	timm
  EfficientFormer	EfficientFormer: Vision Transformers at MobileNet Speed	timm
  EfficientNet	EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks	timm
  EfficientNet-Lite	EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks	timm
  EfficientNetV2	EfficientNetV2: Smaller Models and Faster Training	timm
  FlexiViT	FlexiViT: One Model for All Patch Sizes	timm
  InceptionNeXt	InceptionNeXt: When Inception Meets ConvNeXt	timm
  Inception-ResNet-v2	Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning	timm
  Inception-v3	Rethinking the Inception Architecture for Computer Vision	timm
  Inception-v4	Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning	timm
  LeViT	LeViT: a Vision Transformer in ConvNet's Clothing for Faster Inference	transformers
  MaxViT	MaxViT: Multi-Axis Vision Transformer	timm
  MiT	SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformers	transformers
  MLP-Mixer	MLP-Mixer: An all-MLP Architecture for Vision	timm
  MobileNetV2	MobileNetV2: Inverted Residuals and Linear Bottlenecks	timm
  MobileNetV3	Searching for MobileNetV3	keras
  MobileNetV4	MobileNetV4 - Universal Models for the Mobile Ecosystem	keras
  MobileViT	MobileViT: Light-weight, General-purpose, and Mobile-friendly Vision Transformer	transformers
  MobileViTV2	Separable Self-attention for Mobile Vision Transformers	transformers
  NextViT	Next-ViT: Next Generation Vision Transformer for Efficient Deployment in Realistic Industrial Scenarios	timm
  PiT	Rethinking Spatial Dimensions of Vision Transformers	timm
  PoolFormer	MetaFormer is Actually What You Need for Vision	timm
  PVT	Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutions	transformers
  PVTv2	PVTv2: Improved Baselines with Pyramid Vision Transformer	transformers
  RegNet	Designing Network Design Spaces	transformers
  Res2Net	Res2Net: A New Multi-scale Backbone Architecture	timm
  ResMLP	ResMLP: Feedforward networks for image classification with data-efficient training	timm
  ResNet	Deep Residual Learning for Image Recognition	timm
  ResNetV2	Identity Mappings in Deep Residual Networks	timm
  ResNeXt	Aggregated Residual Transformations for Deep Neural Networks	timm
  SENet	Squeeze-and-Excitation Networks	timm
  Swin Transformer	Swin Transformer: Hierarchical Vision Transformer using Shifted Windows	timm
  Swin Transformer V2	Swin Transformer V2: Scaling Up Capacity and Resolution	timm
  VGG	Very Deep Convolutional Networks for Large-Scale Image Recognition	timm
  ViT	An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale	timm
  Xception	Xception: Deep Learning with Depthwise Separable Convolutions	timm

• Object Detection

  🏷️ Model Name	📜 Reference Paper	📦 Source of Weights
  D-FINE	D-FINE: Redefine Regression Task of DETRs as Fine-grained Distribution Refinement	transformers
  DETR	End-to-End Object Detection with Transformers	transformers
  Table Transformer	PubTables-1M: Towards comprehensive table extraction from unstructured documents	transformers
  EfficientDet	EfficientDet: Scalable and Efficient Object Detection	automl
  RT-DETR	DETRs Beat YOLOs on Real-time Object Detection	transformers
  RT-DETRv2	RT-DETRv2: Improved Baseline with Bag-of-Freebies for Real-Time Detection Transformers	transformers
  RF-DETR	RF-DETR: Neural Architecture Search for Real-Time Detection Transformers	transformers
  OWL-ViT	Simple Open-Vocabulary Object Detection with Vision Transformers	transformers
  OWLv2	Scaling Open-Vocabulary Object Detection	transformers
  Grounding DINO	Marrying DINO with Grounded Pre-Training for Open-Set Object Detection	transformers

• Segmentation

  🏷️ Model Name	📜 Reference Paper	📦 Source of Weights
  BEiT	BEiT: BERT Pre-Training of Image Transformers	transformers
  DeepLabV3	Rethinking Atrous Convolution for Semantic Image Segmentation	torchvision
  EoMT	Your ViT is Secretly an Image Segmentation Model	transformers
  MaskFormer	Per-Pixel Classification is Not All You Need for Semantic Segmentation	transformers
  Mask2Former	Masked-attention Mask Transformer for Universal Image Segmentation	transformers
  MobileViT	MobileViT: Light-weight, General-purpose, and Mobile-friendly Vision Transformer	transformers
  MobileViTV2	Separable Self-attention for Mobile Vision Transformers	transformers
  OneFormer	OneFormer: One Transformer to Rule Universal Image Segmentation	transformers
  RF-DETR	RF-DETR: Neural Architecture Search for Real-Time Detection Transformers	transformers
  SAM	Segment Anything	transformers
  SAM2	SAM 2: Segment Anything in Images and Videos	transformers
  SAM3	SAM 3: Segment Anything with Concepts	transformers (gated)
  SegFormer	SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformers	transformers

• Feature Extraction

  🏷️ Model Name	📜 Reference Paper	📦 Source of Weights
  DINO	Emerging Properties in Self-Supervised Vision Transformers	torch.hub
  DINOv2	DINOv2: Learning Robust Visual Features without Supervision	transformers
  DINOv3	DINOv3: Self-Supervised Visual Representation Learning at Scale	transformers (gated)

• Depth Estimation

  🏷️ Model Name	📜 Reference Paper	📦 Source of Weights
  Depth Anything V1	Depth Anything: Unleashing the Power of Large-Scale Unlabeled Data	transformers
  Depth Anything V2	Depth Anything V2	transformers
  TIPSv2-DPT	TIPSv2: Advancing Vision-Language Pretraining with Enhanced Patch-Text Alignment	transformers

🖼️ Multimodal Models

• Vision-Language Encoders

  🏷️ Model Name	📜 Reference Paper	📦 Source of Weights
  CLIP	Learning Transferable Visual Models From Natural Language Supervision	transformers
  MetaCLIP 2	MetaCLIP 2: A Worldwide Scaling Recipe	transformers
  SigLIP	Sigmoid Loss for Language Image Pre-Training	transformers
  SigLIP2	SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Features	transformers
  TIPSv2	TIPSv2: Advancing Vision-Language Pretraining with Enhanced Patch-Text Alignment	transformers

• Multimodal LLMs (image + text → text)

  🏷️ Model Name	📜 Reference Paper	📦 Source of Weights
  Qwen2-VL	Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolution	transformers
  Qwen2.5-VL	Qwen2.5-VL Technical Report	transformers
  Qwen3-VL	Qwen3 Technical Report	transformers
  Qwen3-VL-MoE	Qwen3 Technical Report	transformers
  Qwen3.5-MoE	Qwen3 Technical Report	transformers
  InternVL3	InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Models	transformers
  Gemma 3	Gemma 3 Technical Report	transformers (gated)
  Gemma 3n	google/gemma-3n-E4B	transformers (gated)
  Gemma 4	Gemma 4 Technical Report	transformers
  Gemma 4 Unified	Gemma 4 Technical Report	transformers
  Mistral 3	mistralai/Mistral-Small-3.1-24B-Instruct-2503	transformers
  DeepSeek-VL	DeepSeek-VL: Towards Real-World Vision-Language Understanding	transformers
  Janus-Pro	Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scaling	transformers
  MiniMax-M3-VL	MiniMax-M3 Technical Report	transformers
  GLM-4V (GLM-4.1V)	GLM-4.1V-Thinking: Towards Versatile Multimodal Reasoning with Scalable Reinforcement Learning	transformers
  GLM-4.5V (MoE)	GLM-4.1V-Thinking: Towards Versatile Multimodal Reasoning with Scalable Reinforcement Learning	transformers
  Kimi K2.5 / K2.6 / K2.7-Code	Kimi K2.5 Technical Report	transformers

• Vision-Language Grounding (object detection, OCR, pointing, referring)

  🏷️ Model Name	📜 Reference Paper	📦 Source of Weights
  LocateAnything	LocateAnything: Fast and High-Quality Vision-Language Grounding with Parallel Box Decoding	transformers

• Text-to-Image Diffusion (text → image)

  🏷️ Model Name	📜 Reference Paper	📦 Source of Weights
  Stable Diffusion 1.x (v1-1 to v1-5)	High-Resolution Image Synthesis with Latent Diffusion Models	diffusers
  Stable Diffusion 2.x (2, 2-base, 2-1, 2-1-base, SD-Turbo)	High-Resolution Image Synthesis with Latent Diffusion Models	diffusers
  Stable Diffusion XL (base + refiner 1.0, SDXL-Turbo)	SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesis	diffusers
  Stable Diffusion 3 (medium)	Scaling Rectified Flow Transformers for High-Resolution Image Synthesis	diffusers
  Stable Diffusion 3.5 (large, large-turbo, medium)	Scaling Rectified Flow Transformers for High-Resolution Image Synthesis	diffusers
  Qwen-Image	Qwen-Image Technical Report	diffusers
  Qwen-Image-2.1	Qwen/Qwen-Image-2.1 (single-stream DiT + Qwen3-VL)	diffusers

🔊 Audio Models

• Speech (speech → text)

  🏷️ Model Name	📜 Reference Paper	📦 Source of Weights
  Whisper	Robust Speech Recognition via Large-Scale Weak Supervision	transformers
  Speech2Text	fairseq S2T: Fast Speech-to-Text Modeling with fairseq	transformers
  Moonshine	Moonshine: Speech Recognition for Live Transcription and Voice Commands	transformers
  Granite Speech 5	Granite-speech: open-source speech-aware LLMs with strong English ASR capabilities	transformers

• Speech LLMs (audio + text → text)

  🏷️ Model Name	📜 Reference Paper	📦 Source of Weights
  Granite Speech	Granite-speech: open-source speech-aware LLMs with strong English ASR capabilities	transformers
  Granite Speech Plus	Granite Speech Plus Technical Report	transformers

📜 License

This project leverages timm, transformers and diffusers for converting pretrained weights from PyTorch to Keras. For licensing details, please refer to the respective repositories. Converted weights keep their upstream license (for example, the Stable Diffusion checkpoints are CreativeML OpenRAIL-M / OpenRAIL++-M, SDXL-Turbo is non-commercial under the Stability AI Community License, Qwen-Image is Apache-2.0, and Qwen-Image-2.1 is under the Qwen Research License).

• 🔖 zeromodels Code: This repository is licensed under the Apache 2.0 License.

🌟 Credits

• The Keras team for their powerful and user-friendly deep learning framework
• The Transformers library for its robust tools for loading and adapting pretrained models
• The pytorch-image-models (timm) project for pioneering many computer vision model implementations
• The Diffusers library, the reference the diffusion models are converted from and verified against
• The Sentence Transformers project for its sentence-embedding checkpoints and preprocessing recipes
• All contributors to the original papers and architectures implemented in this library

Citing

BibTeX

@misc{gc2025zeromodels,
  author = {Gitesh Chawda},
  title = {ZeroModels},
  year = {2025},
  publisher = {GitHub},
  journal = {GitHub repository},
  howpublished = {\url{https://github.com/IMvision12/ZeroModels}}
}