January 1, 2000
Groq is fast
It use a different inference method to work with large language models, and its respose time is one order of magnitude different.
We believe that the response time will play a crucial role in shaping new type of interaction between human being and software.
For this reason, we experiments continuously with all the LLM alternative to find the right balance between results and performance.
In retool you need to create a new REST API resource
configuring the base URL
adding the Groq token in the header
Prepare the body
We help ambitious companies ride the change