⚡

Groq

groq.com →

Freemium

Description

Ultra-fast LLM inference — 300+ tokens/second with open-source models

Tags

fastinferenceopen-source

How to Use

Freemium — paid upgrades available. Groq is a freemium more tool. Visit the official site to get started. Ultra-fast LLM inference — 300+ tokens/second with open-source models