8

ALTERNATIVES
FOR OPENAI API

@AndrejsKarpovs
1
ANTHROPIC

Arguably the main OpenAI competitor right now.

Two model versions: Claude Instant and Claude 2,
presented as analogs to GPT-3.5 and GPT-4 (one
model is faster, the other is smarter).

Pros:
— prices are cheaper than OpenAI
— for high traffic, there is inference via Amazon
Bedrock Among
— Claude 2.1 (Beta) has 200K context length

Cons:
— all prompts will have to be migrated in a special
way, with a focus on XML (this is how the request
structuring to the models is designed).
2
COHERE

Empowers enterprises to build amazing products

and capture true business value with language AI.

Pros:
— The Coral and Command assistants, based on
RAG (retrieval-augmented generation)
— effectively solve tasks related to information
retrieval, searching, and reading documents
— hallucinate less
— ready-made intents for continuing chats, writing
texts, summarizing, and searching
— lot of documentation, and prepared use cases

Cons:
— Mainly supports only English language
3
INFLECTION AI

AI Studio creating a personal AI for everyone.

Pros:
— Has almost same amount of features and
functions as OpenAI
— Main product Pi Assistant is more personalized,
much safer, prioritizes people not productivity
— extra features like calendar planning, assistance in
writing texts with complex structures

Cons:
— To access the API, one must join a waitlist.
4
STABILITY AI

Stability AI (Stable Diffusion) primarily sells APIs for

image generation and upscaling models, but very
recently, language models named Stable LM have
been added to their range of developments.

Pros:
— The latest development is the Stable Beluga model
with 70 billion parameters.

Cons:
— currently not directly available via API, and we are
awaiting its addition to the lineup of models
accessible through the API.
5
PERPLEXITY AI

A ready-made API service for optimized, fast

inference of open LLMs: Mistral 7B, Llama2 13B, Code
Llama 34B, Llama2 70B, replit-code-v1.5-3b. Among
the available models, there is no proprietary model.

Pros:
— delivers more precise and relevant search results
than traditional search engines
— includes references used by the system to find
information

Cons:
— presentation of information does not fully use
flowing and natural language like normal human
conversation
6
AMAZON
BEDROCK
Fully managed service from Amazon Web Services.

Pros:
— Affordable and effective
— connect to models already available on AWS
— ready inference of a large number of models,
including those mentioned startups, as well as Llama
2 (Meta), Jurassic (A21 labs), Titan (Amazon
research)

Cons:
— Might require deeper understanding of AWS tools
and API management
7
MISTRAL AI

Committed to Open Source (Open Models). Go fast

and work very intensely.

Pros:
— Open and transparrent
— Access to model weights permitting full
customization
— Newly released Mixtral 8x7B model pushing frontier
of open models with sparse architectures

Cons:
— Very small team, potentially causing issues with
support
8
VERTEX AI

Fully managed service from Google.

Pros:
— Seamless integration with popular Google services:
AutoML, BigQuery, etc.
— Integration with BigQuery ML for SQL-Based model
creation
— Very good documentation and learning paths for
Generative AI

Cons:
— Lack of transparrency and trust for latest and
greatest models, e.g. Gemini
— Lack of advanced features
THAT’S IT.

WOULD YOU
ADD TO THE
LIST?

@AndrejsKarpovs