AI glossary first submission #525

kelbrown20 · 2025-05-13T18:52:34Z

This PR adds new AI terms to the style guide glossary

bergerhoffer

Here's a first pass at a few bits of feedback!

supplementary_style_guide/glossary_terms_conventions/general_conventions/i.adoc

bergerhoffer · 2025-06-16T17:20:03Z

@kelbrown20 Is this ready for a re-review?

kelbrown20 · 2025-06-24T13:29:46Z

My apologies for the delay @bergerhoffer!
Yes I believe I fixed everything, but def lmk if there was something I might have missed

sbmetz

Some minor wording tweaks

supplementary_style_guide/glossary_terms_conventions/general_conventions/i.adoc

aireilly · 2025-07-23T19:37:21Z

supplementary_style_guide/glossary_terms_conventions/general_conventions/i.adoc

+*See also*:
+
+[[inference-serving]]
+==== image:images/yes.png[yes] inference serving (verb)


So is "inferencing" accepted verb usage for serving models? For example, "inferencing the quantized granite model".

So this is a great point, early on when researching this, I rarely ever saw usage of the the verb form "inferencing" , but Ive been seeing it more and more and It seems like its a standard. I think part of the confusing part was it seemed like PMs were using "inference serving" primarily as the single word for both inferencing and serving, which still works for certain contexts. So I'll keep this term, update the description to make that more clear, and make "inferencing" an option

Seems jargony to me, vs "performing/running inference" or "inference serving". (ChatGPT and Gemini support this analysis 😃 )

@sbmetz @kelbrown20
https://arxiv.org/search/?query=%22Inference+serving%22&searchtype=all&abstracts=show&order=-announced_date_first&size=50
vs.
https://arxiv.org/search/?query=Inferencing&searchtype=all&source=header

Both appear widely used in academic papers.

From what I see, I think the its the noun form vs the verb form of inferencing. I saw inferencing used more as a noun when going through those a few of those articles. I do think I need to update these but @aireilly what do you think of the new defs with examples

aireilly

Added some suggestions

aireilly · 2025-11-04T09:04:22Z

supplementary_style_guide/glossary_terms_conventions/general_conventions/i.adoc

+
+*See also*:
+
+[[inferencing]]


Suggested change

[[inferencing]]

[[inference serving]]

"Inference serving" seems to be the proper form.

They seem to both be correct terms, but they have different meanings.

OK. So maybe we need "inferencing" and "inference serving"?

Inferencing - the process of running a model
Inference Serving - deploying the inferencing capability on a server

Something like this?

Yes, that looks about right.

aireilly · 2025-11-04T09:04:26Z

supplementary_style_guide/glossary_terms_conventions/general_conventions/i.adoc


+[[inference]]
+==== image:images/yes.png[yes] inference (noun)
+*Description*: The act a model generating outputs from input data. For example, "Inference speeds increased on the new models"


Suggested change

*Description*: The act a model generating outputs from input data. For example, "Inference speeds increased on the new models"

*Description*: The process in which a trained model is loaded into memory and generates output based on input data.

For example, "The Llama-3.2-90B-Vision-Instruct-FP8-dynamic model performs inference to identify objects in an image."

@aireilly This is an improvement in the definition. Thanks. I'd like to rewrite this a bit. In general, we write definitions as complete sentences. How's this?

Suggested change

*Description*: The act a model generating outputs from input data. For example, "Inference speeds increased on the new models"

*Description*: AI inference is the process in which a trained model is loaded into memory and then the makes predictions or performs tasks on new data. For example, "The Llama-3.2-90B-Vision-Instruct-FP8-dynamic model performs inference to identify objects in an image."

Suggested change

*Description*: The act a model generating outputs from input data. For example, "Inference speeds increased on the new models"

*Description*: AI inference is the process in which a trained model is loaded into memory and then makes predictions based on input data. For example, "The Llama-3.2-90B-Vision-Instruct-FP8-dynamic model performs inference to identify objects in an image."

What about this?

aireilly · 2025-11-04T09:24:50Z

supplementary_style_guide/glossary_terms_conventions/general_conventions/i.adoc

+
+[[inferencing]]
+==== image:images/yes.png[yes] inferencing (noun)
+*Description*: A process by which a model processes input data, deduce information, and generates an output. For example, "The inferencing workload is distributed across multiple accelerators."


Suggested change

*Description*: A process by which a model processes input data, deduce information, and generates an output. For example, "The inferencing workload is distributed across multiple accelerators."

*Description*: The act of deploying and running a trained model so that it can process input data and generate output.

For example, "Use vLLM to inference serve a trained model."

@aireilly Both definitions are correct. We just have to decide if we want to put both "inferencing" and "inference serving" in the SSG or choose one over the other.

IngridT1

I won't be able to merge these without some discussion and changes.

IngridT1 · 2025-11-04T15:56:02Z

supplementary_style_guide/glossary_terms_conventions/general_conventions/i.adoc


+[[inference]]
+==== image:images/yes.png[yes] inference (noun)
+*Description*: The act a model generating outputs from input data. For example, "Inference speeds increased on the new models"


@aireilly This is an improvement in the definition. Thanks. I'd like to rewrite this a bit. In general, we write definitions as complete sentences. How's this?

Suggested change

*Description*: The act a model generating outputs from input data. For example, "Inference speeds increased on the new models"

*Description*: AI inference is the process in which a trained model is loaded into memory and then the makes predictions or performs tasks on new data. For example, "The Llama-3.2-90B-Vision-Instruct-FP8-dynamic model performs inference to identify objects in an image."

IngridT1 · 2025-11-04T15:57:43Z

supplementary_style_guide/glossary_terms_conventions/general_conventions/i.adoc

+
+*See also*:
+
+[[inferencing]]


They seem to both be correct terms, but they have different meanings.

IngridT1 · 2025-11-04T15:58:28Z

supplementary_style_guide/glossary_terms_conventions/general_conventions/i.adoc

+
+[[inferencing]]
+==== image:images/yes.png[yes] inferencing (noun)
+*Description*: A process by which a model processes input data, deduce information, and generates an output. For example, "The inferencing workload is distributed across multiple accelerators."


@aireilly Both definitions are correct. We just have to decide if we want to put both "inferencing" and "inference serving" in the SSG or choose one over the other.

bergerhoffer reviewed May 15, 2025

View reviewed changes

bergerhoffer added the Glossary entry Topics that add or modify glossary entries label May 15, 2025

kelbrown20 force-pushed the ai-glossary-updates-v1 branch from 57f011f to 428a59e Compare May 28, 2025 19:33

kelbrown20 force-pushed the ai-glossary-updates-v1 branch from 428a59e to cd48339 Compare June 24, 2025 13:28

sbmetz reviewed Jul 23, 2025

View reviewed changes

supplementary_style_guide/glossary_terms_conventions/general_conventions/i.adoc Outdated Show resolved Hide resolved

supplementary_style_guide/glossary_terms_conventions/general_conventions/i.adoc Outdated Show resolved Hide resolved

aireilly reviewed Jul 23, 2025

View reviewed changes

AI glossary first submission

0aa5764

kelbrown20 force-pushed the ai-glossary-updates-v1 branch from cd48339 to 0aa5764 Compare July 24, 2025 14:58

aireilly reviewed Nov 4, 2025

View reviewed changes

IngridT1 requested changes Nov 4, 2025

View reviewed changes

	Description: The act a model generating outputs from input data. For example, "Inference speeds increased on the new models"
	Description: The process in which a trained model is loaded into memory and generates output based on input data.
	For example, "The Llama-3.2-90B-Vision-Instruct-FP8-dynamic model performs inference to identify objects in an image."

	Description: The act a model generating outputs from input data. For example, "Inference speeds increased on the new models"
	Description: AI inference is the process in which a trained model is loaded into memory and then the makes predictions or performs tasks on new data. For example, "The Llama-3.2-90B-Vision-Instruct-FP8-dynamic model performs inference to identify objects in an image."

	Description: A process by which a model processes input data, deduce information, and generates an output. For example, "The inferencing workload is distributed across multiple accelerators."
	Description: The act of deploying and running a trained model so that it can process input data and generate output.
	For example, "Use vLLM to inference serve a trained model."

AI glossary first submission #525

Are you sure you want to change the base?

AI glossary first submission #525

Uh oh!

Conversation

kelbrown20 commented May 13, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

bergerhoffer left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

bergerhoffer commented Jun 16, 2025

Uh oh!

kelbrown20 commented Jun 24, 2025

Uh oh!

sbmetz left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Choose a reason for hiding this comment

Uh oh!

kelbrown20 Jul 23, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

aireilly Jul 24, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

kelbrown20 Jul 24, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

aireilly left a comment

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

IngridT1 left a comment

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

kelbrown20 commented May 13, 2025 •

edited

Loading

kelbrown20 Jul 23, 2025 •

edited

Loading

aireilly Jul 24, 2025 •

edited

Loading

kelbrown20 Jul 24, 2025 •

edited

Loading