Conversation
|
The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update. |
| | User Tier | Included monthly credits | | ||
| | ------------------------ | ---------------------------------- | | ||
| | Free Users | subject to change, less than $0.10 | | ||
| | PRO and Enterprise Users | $2.00 | |
There was a problem hiding this comment.
it would be great to have a third column with an estimation on how much I can generate (might be hard)
There was a problem hiding this comment.
deleted since duplicate of chat-completion.md
julien-c
left a comment
julien-c
left a comment
There was a problem hiding this comment.
will need more review but a nice start 🔥
docs/api-inference/index.md
Outdated
| # Inference Providers API | ||
|
|
||
| **Instant Access to thousands of ML Models for Fast Prototyping** | ||
| The Hugging Face Inference Providers API revolutionizes how developers access and run machine learning models by offering a unified, flexible interface to multiple serverless inference providers. This new approach extends our previous Serverless Inference API, providing more models, increased performances and better reliability thanks to our awesome partners. |
There was a problem hiding this comment.
add nice visual of all providers
Co-authored-by: Julien Chaumond <julien@huggingface.co>
Co-authored-by: Julien Chaumond <julien@huggingface.co>
Co-authored-by: Julien Chaumond <julien@huggingface.co>
…ingface/hub-docs into refacto-for-inference-providers-doc
Co-authored-by: Julien Chaumond <julien@huggingface.co>
…uggingface/hub-docs into refacto-for-inference-providers-doc
burtenshaw
left a comment
burtenshaw
left a comment
There was a problem hiding this comment.
Nice few pages. I left some small nits to help with readability.
|
Valuable feedback, thanks for taking the time Ben! ❤️ |
Co-authored-by: burtenshaw <ben.burtenshaw@gmail.com>
Vaibhavs10
left a comment
Vaibhavs10
left a comment
There was a problem hiding this comment.
Very cool, just one comment about openai snippets - they do get a lot of usage, would be nice to fit them somewhere
| print(response.json()["choices"][0]["message"]) | ||
| ``` | ||
|
|
||
| For convenience, the Python library `huggingface_hub` provides an [`InferenceClient`](https://huggingface.co/docs/huggingface_hub/guides/inference) that handles inference for you. Make sure to install it with `pip install huggingface_hub`. |
There was a problem hiding this comment.
would it make sense to add an openai snippet too or is it a hassle because of the mapping thingy?
A lot of people use the openai package would be great to figure out a way to showcase that.
There was a problem hiding this comment.
there will be openai snippets for both Python and JS in individual tasks page (e.g. in chat-completion). This is done in a separate PR: #1643
There was a problem hiding this comment.
but I don't think we'll feature it on the landing page, there are already many snippets on that page
Co-authored-by: Pierric Cistac <Pierrci@users.noreply.github.com>
Co-authored-by: Victor Muštar <victor.mustar@gmail.com>
Co-authored-by: Victor Muštar <victor.mustar@gmail.com>
|
Thanks for the reviews! I just merged it and created #1662 to list remaining items :) |
8 participants
Main pages to look at:
TODO list: