When using the Inference API, you will probably encounter some limitations. Subscribe to the PRO plan to avoid getting rate limited in the free tier. Requests for code generation are made via an HTTP ...
We conduct an extensive evaluation of our code models on a comprehensive list of benchmarks that includes but is not limited to HumanEvalPack, MBPP, and MBPP+. This set of benchmarks encompasses ...
Some results have been hidden because they may be inaccessible to you
Show inaccessible results
Feedback