> ## Documentation Index
> Fetch the complete documentation index at: https://docs.nextchat.dev/llms.txt
> Use this file to discover all available pages before exploring further.

# Groq

[Groq's](https://groq.com/) hosted models offer key advantages including exceptional performance efficiency due to optimized hardware, simplified integration for easy deployment in various applications, and scalability to handle growing data demands. Additionally, they provide cost-effectiveness by reducing the need for extensive hardware investments and support for a wide range of applications, ensuring versatility across industries. This combination of benefits makes Groq's hosted models an attractive solution for businesses seeking to leverage advanced AI and ML capabilities efficiently.

Groq's technology significantly reduces latency, offering a competitive edge in environments where every millisecond counts.

<video autoPlay loop>
  <source src="https://mintcdn.com/nextchat/L163PIqDpabc9Er_/images/models/groq/groq.mp4?fit=max&auto=format&n=L163PIqDpabc9Er_&q=85&s=c1853e983f2332801ffc4ab3910a5e10" type="video/mp4" data-path="images/models/groq/groq.mp4" />

  Your browser does not support the video tag.
</video>

# Using Groq with custom endpoint

<img src="https://mintcdn.com/nextchat/L163PIqDpabc9Er_/images/models/groq/config.png?fit=max&auto=format&n=L163PIqDpabc9Er_&q=85&s=430504d1508146ad27343f5dae5a91d3" alt="Settings Page" width="2808" height="2180" data-path="images/models/groq/config.png" />

<Steps>
  <Step title="Open Settings Page">
    Click Settings at the left bottom of the page.
  </Step>

  <Step title="Config Groq Endpoint">
    Enable custom endpoint and input the groq api endpoint: `https://api.groq.com/openai/`
  </Step>

  <Step title="Config Groq API Key">
    Set yhe groq api key you obtained from [https://console.groq.com/keys](https://console.groq.com/keys) in the `API Key` field.

    <img src="https://mintcdn.com/nextchat/L163PIqDpabc9Er_/images/models/groq/groq-api-key.png?fit=max&auto=format&n=L163PIqDpabc9Er_&q=85&s=9dced50b8b16f08c2cefb26da6e8fe01" alt="API Key" width="3352" height="1890" data-path="images/models/groq/groq-api-key.png" />
  </Step>

  <Step title="Set custom model supported by Groq">
    Set your model name(e.g.  `llama2-70b-4096`)
  </Step>

  <Step title="(Optional) Change default model to groq">
    Change the default model to the groq model you set in the previous step.
  </Step>
</Steps>

Then switch to chat page and start have fun with Groq model!