-
Notifications
You must be signed in to change notification settings - Fork 932
google cloud #3166
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
google cloud #3166
Changes from 10 commits
3f3ede8
9d1e3e3
cd2f2a7
c601921
b0caee0
c8c867c
23de988
42c6c51
ba6501f
143f5fa
2f29ed3
72dda0c
93d3bc8
d46e7e0
592fa6f
b6c44c7
7fedb26
File filter
Filter by extension
Conversations
Jump to
Diff view
Diff view
There are no files selected for viewing
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1 @@ | ||
|
|
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,52 @@ | ||
| --- | ||
| title: "Building for an Open Future - our new partnership with Google Cloud" | ||
| thumbnail: /blog/assets/google-cloud/google-cloud-thumbnail.png | ||
| authors: | ||
| - user: jeffboudier | ||
| - user: pagezyhf | ||
| --- | ||
|
|
||
| # Building for an Open Future - our new partnership with Google Cloud | ||
|
|
||
| <img src="https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/blog/google-cloud/google%20cloud%20blogpost%20title.png"> | ||
|
|
||
| Today, we are happy to announce a new and deeper partnership with Google Cloud, to enable companies to build their own AI with open models. | ||
pagezyhf marked this conversation as resolved.
Show resolved
Hide resolved
|
||
|
|
||
| “_Google has made some of the most impactful contributions to open AI, from the OG transformer to the Gemma models. I believe in a future where all companies will build and customize their own AI_” says Jeff Boudier, at Hugging Face. “_With this new strategic partnership, we will make it easy to do on Google Cloud._” | ||
|
||
|
|
||
| “_Hugging Face has been the driving force enabling companies large and small all over the world to access, use and customize now more than 2 million open models, and we’ve been proud to contribute over 1,000 of our models to the community_”, says Ryan J. Salva, Senior Director of Product Management at Google Cloud. “_Together we will make Google Cloud the best place to build with open models._” | ||
|
|
||
| ## A Partnership for Google Cloud customers | ||
|
|
||
| Google Cloud customers use open models from Hugging Face in many of its leading AI services. In Vertex AI, the most popular open models are ready to deploy in a couple clicks within Model Garden. Customers who want greater control over their AI infrastructure can find a similar model library available in GKE AI/ML, or use pre-configured environments maintained by Hugging Face. Customers also run AI inference workloads with Cloud Run GPUs, enabling serverless open model deployments. | ||
|
|
||
| The common thread: we work with Google Cloud to build seamless experiences fully leveraging the unique capabilities of each service to offer choice to the customers. | ||
pagezyhf marked this conversation as resolved.
Show resolved
Hide resolved
|
||
|
|
||
| <img src="https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/blog/google-cloud/google-cloud-partnership.png"> | ||
|
|
||
| ## The Gateway to Open Models - A Fast Lane for Google Cloud Customers | ||
|
|
||
| Usage of Hugging Face by Google Cloud customers has grown 10x over the last 3 years, and today, this translates into tens of petabytes of model downloads every month, in billions of requests. | ||
|
|
||
| To make sure Google Cloud customers have the best experience building with models and datasets from Hugging Face, we are working together to create a CDN Gateway for Hugging Face repositories built on top of Hugging Face Xet optimized storage and data transfer technologies, and of Google Cloud advanced storage and networking capabilities. | ||
pagezyhf marked this conversation as resolved.
Outdated
Show resolved
Hide resolved
|
||
|
|
||
| This CDN Gateway will cache Hugging Face models and datasets directly on Google Cloud to significantly reduce downloading times, and strengthen model supply chain robustness for Google Cloud customers. Whether you’re using Vertex, GKE, Cloud Run or just building your own stack in VMs in Compute Engine, you will benefit from faster time-to-first-token and simplified model governance. | ||
|
|
||
| ## A partnership for Hugging Face customers | ||
|
|
||
| Hugging Face [Inference Endpoints](https://endpoints.huggingface.co/) is the easiest way to go from model to deployment in just a couple clicks. Through this deepened partnership we will bring the unique capabilities and cost performance of Google Cloud to Hugging Face customers, starting with Inference Endpoints. Expect more and newer instances available as well as price drops! | ||
|
|
||
| <img src="https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/blog/google-cloud/inference-endpoints-google-cloud.png"> | ||
|
|
||
| We will ensure all the fruits of our product and engineering collaboration become easily available to the 10 million AI Builders on Hugging Face. Going from a model page to deploying on Vertex Model Garden or GKE should only take a couple steps. Taking a private model securely hosted in an Enterprise organization on Hugging Face should be as easy as working with public models. | ||
|
|
||
| TPUs, Google custom AI accelerator chips now in their seventh generation, have been steadily improving in performance and software stack maturity. We want to make sure Hugging Face users can fully benefit from the current and the next generations of TPUs when they build AI with open models. We are excited to make TPUs as easy to use as GPUs for Hugging Face models, thanks to native support in our libraries. | ||
|
|
||
| Additionally, this new partnership will enable Hugging Face to leverage Google industry-leading security technology to make the millions of open models on Hugging Face more secure. Powered by [Google Threat Intelligence](https://cloud.google.com/security/products/threat-intelligence) and [Mandiant](https://www.mandiant.com/), this joint effort aims to secure models, datasets and Spaces as you use the Hugging Face Hub daily. | ||
|
Member
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. mention virustotal as well?
Contributor
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. I added in a new PR |
||
| Building the open future of AI together | ||
pagezyhf marked this conversation as resolved.
Outdated
Show resolved
Hide resolved
|
||
|
|
||
| We want to see a future where every company can build their own AI with open models, and control and host it within their own secure infrastructure. We are excited to make this future happen with Google Cloud, and our deep collaboration with Google will accelerate this vision, whether you are using Vertex Model Garden, GKE, Cloud Run or Hugging Face Inference Endpoints. | ||
pagezyhf marked this conversation as resolved.
Outdated
Show resolved
Hide resolved
|
||
|
|
||
| Is there something you want us to create or improve thanks to our partnership with Google? Let us know in the comments! | ||
|
|
||
| <img src="https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/blog/google-cloud/mcface-billion-model-served-compressed.png"> | ||
Uh oh!
There was an error while loading. Please reload this page.