models

Subscribe to all “models” posts via RSS or follow GitHub Changelog on Twitter to stay updated on everything we ship.

~ cd github-changelog
~/github-changelog|main git log main
showing all changes successfully

You can now access a new prompt editor within GitHub Models, purpose-built to help you iterate, refine, and perfect your prompts. This powerful tool is designed to provide a focused and intuitive experience for crafting and testing your inputs, enabling you to optimize prompts for maximum performance and relevance in your projects. Whether you’re fine-tuning for precision or experimenting with different approaches, this editor empowers you to unlock the full potential of the models with ease and efficiency.

Image of prompt editor

This addition empowers you to:
– Quickly test and refine prompts without the complexity of multi-turn interactions.
– Utilize a dedicated space for single-turn message scenarios to ensure consistent results.

Start experimenting with the new prompt editor today!

Learn more about GitHub Models or join the conversation in our community discussions.

See more

GitHub Models makes it easy for every developer to build AI features and products directly on GitHub. Try and compare models for free in the playground, or integrate all 40+ models into your app with just one API key.

models sorting options

In order to improve navigation thorugh our growing catalog of models, you can now sort models by:

  • Alphabetical
  • Recently added
  • Output token limit (maximum text generated by the model)
  • Input token limit (maximum text length model can process)

Learn more about GitHub Models or share feedback in our community discussions.

See more

Phi-4 Model Release on GitHub Models

The latest AI model from Phi, Phi-4, is now available in GitHub Models.

Phi-4 is a 14B parameter state-of-the-art small language model (SLM) that excels at complex reasoning and conventional language processing.

GitHub Models makes it easy for every developer to build AI features and products on GitHub.

Easily try, compare, and implement this model in your code for free in the playground or via the API. Compare it to a previous Phi model using the side-by-side feature in GitHub Models.

To learn more about GitHub Models, check out product documentation on GitHub Models. You can also join our community discussions.

See more

The latest AI model from Mistral, Codestral 25.01, is now available in GitHub Models.

Codestral 25.01 is explicitly designed for code generation tasks. It helps developers write and interact with code through a shared instruction and completion API endpoint. As it masters code and can also converse in a variety of languages, it can be used to design advanced AI applications for software developers.

GitHub Models makes it easy for every developer to build AI features and products on GitHub.

Easily try, compare, and implement this model in your code for free in the playground or via the API. Compare it to other code generation models using the side-by-side feature in GitHub Models.

To learn more about GitHub Models, check out the docs. You can also join our community discussions.

See more

You can now specify a custom JSON schema as a response format, alongside the existing text and recently released general JSON option. When JSON schema is selected, an input box will allow you to define your desired schema format directly in the playground.

JSON Schema support in Models

This enhancement provides more control if you’re working with models that require structured responses, helping to mitigate issues like models outputting unnecessary tokens. You can either specify a single object or an array of objects. Additionally, you can save this JSON schema as a preset so that you can use it again later.

JSON Schema structured outputs are currently only supported for the GPT 4o model, and specifically for the api-version: “2024-08-01-preview”.

GitHub Models is a catalog and playground of AI models to help you build AI features and products. You can start using models for free with just your GitHub PAT.

Learn more about GitHub Models or join the conversation in our community discussions.

See more

GitHub Models makes it easy for every developer on GitHub to build AI features and products, with access to top AI models via a playground, API, and more.

Today, we’ve added access to OpenAI’s brand new o1 model. The new o1 model replaces o1-preview, and offers even better performance in complex tasks. You can learn more about this launch and its availability on both GitHub Models and Copilot in our blog post.

Start working with o1 directly in our GitHub Models playground. You can even compare it side-by-side with GPT-4o to evaluate how they work differently.

OpenAI o1 in GitHub Models

If you’re ready to jump in and integrate o1 into your code, check out our API.

Learn more about GitHub Models or join the conversation in our community discussions to share your feedback!

See more

The GitHub Models playground now shows your real-time token usage, including both input and output counts, as well as latency information in its responses. The analytics are accessible via the top bar, helping you more efficiently optimize prompts, evaluate model costs, and monitor response times.

Additionally, clicking on the information in the top bar now opens a modal with more details about the token and latency metrics:

Token and latency information in GitHub Models

GitHub Models makes it easy for every developer on GitHub to build AI features and products, with access to top AI models via a playground, API, and more.

To learn more about GitHub Models, check out the docs. You can also join our dedicated community discussion to discuss this update, swap tips, and share feedback.

See more

You can now use the new “Improve Prompt” button next to your system prompt in the Models Playground.

A system prompt is a predefined instruction or guideline that sets the behavior and tone for an AI model, helping it respond in a specific way to user inputs. This AI-powered tool will refine and optimize your prompt to help you get the best possible results from your chosen model.

Prompt improvements

GitHub Models makes it easy for every developer on GitHub to build AI features and products. Easily try, compare, and implement models in your code for free via the playground or API.

Try the “Improve Prompt” feature in the playground, learn more about GitHub Models, or join the conversation in our community discussions.

See more

The latest model from Mistral, Mistral Large 24.11, is now available in GitHub Models. This is an advanced Large Language Model (LLM) with state-of-the-art reasoning, knowledge and coding capabilities.

GitHub Models is a catalog and playground of AI models to help you build AI features and products.

Start exploring this model today in the playground or via the API. Compare it to other Mistral models using the side-by-side feature in GitHub Models, and see the improvement for yourself!

To learn more about GitHub Models, check out the docs. You can also join our community discussions.

See more

Meta has released a new model, Llama 3.3 70B Instruct, now available in GitHub Models. It provides similar performance to Llama 3.1 405B, but at a significantely lower cost, making it a more accessible option for developers.

GitHub Models is a catalog and playground of AI models to help you build AI features and products.

Start exploring Llama 3.3 70B Instruct today in the playground or via the API. Compare it to the old model using the side-by-side feature in GitHub Models, and see the improvement for yourself!

To learn more about GitHub Models, check out the docs. You can also join our dedicated community discussion.

See more

GitHub Models now supports the ability to retrieve structured JSON responses from models, making it easier to integrate AI outputs into applications and workflows.

While this functionality was already available via our API, this update adds it to the UI.

JSON Response in GitHub Models Playground

Supported models include OpenAI (except for o1-mini and o1-preview) and Mistral models.

To learn more about GitHub Models, check out the docs. You can also join our dedicated community discussion to discuss this update, swap tips, and share feedback.

See more

GitHub Models has entered public preview! GitHub Models provides every GitHub developer with access to top AI models via a playground, API, and more.

GitHub Models product screenshot showing the model playground

Since the announcement of GitHub Models almost three months ago, we’ve shipped a number of enhancements and new models.

New features include:

  • Side-by-side comparisons – Compare the output of two models as they respond to the same prompt in real time.
  • Model presets – Save prompts, parameters, and messages to use later or share with a friend.
  • Multimodal support – Provide images in the playground to models that support multimodal capabilities.
  • Streamlined deployment process – Quickly move your application from development to production with an Azure production key.

New surfaces to use models include:

  • Models CLI extension – Use any model from the command line by extending the GitHub CLI with `gh extension install https://github.com/github/gh-models`.
  • Models Copilot extensionInstall the GitHub Models Copilot Extension and call GitHub Models with @models in GitHub Copilot Chat.
  • Azure AI Toolkit for VS Code – Access GitHub Models in VS Code with the pre-release of Azure AI Toolkit, available on the VS Code Marketplace.

New model ships include:

To learn more about GitHub Models, check out the docs.

Join our Community

Join our dedicated Community Discussions to discuss this update, swap tips, and share feedback.

See more