Welcome to EcoLogits! (looking for feedbacks)

[samuelrince]

👋 Welcome to EcoLogits

We're thrilled to announce the initial release of our python package 🌱 EcoLogits. This package has been developed with the aim to simplify the tracking of the energy consumption and the environmental footprint of generative AI models at inference.

As the first set of users, your experience, feedback, and suggestions can play a crucial role in the further development and refinement of EcoLogits. We're eager to hear about:

• Your general feedback and first impressions of the package.
• Any issues or bugs you've encountered during installation or use.
• Any additional features or enhancements you'd like to see in future releases.
• The effectiveness of our documentation and examples.

Also, feel free to:

• Ask any questions or queries related to the package.
• Share your ideas and use-cases where you've implemented EcoLogits.

Let's make EcoLogits better together! And a warm thank you for all the feedbacks! 🙏

[Marie-PerrotDockes]

Hi Samuel,

Thank you for the great app!

I have a question on the expert mode when you compare the impact of an LLM in different countries: the values are obtained as if all the energy used to run an LLM in a given country was produced in this country? Is that the case? (If I ask a question to a LLM in France is it running on a datacenter in France ?)

Best and thank you,

[samuelrince]

Hello @Marie-PerrotDockes,

Thank you for the feedback! You are right, when you change the location it is used to change to the according electricity mix of the selected country. This concerns only the energy consumed by the hardware and cooling inside the data center. So, this basically if you choose France, then it means the data center should be in France.

[aminaslo]

Hello! I would like to include the EcoLogits calculator in an AI usage guidance policy for my organization. I would love if it also provided calculations for image generation; is this something that could be added in the list of sample prompts?

[samuelrince]

Hi @aminaslo, unfortunately we lack comprehensive energy benchmarks of open models for image generation to add it to EcoLogits. For now there is no plan to implement it in the coming months, as this is a lot of work.

Even though newer models are currently not available, you can check the ML.ENERGY Leaderboard to see real-world energy consumption metrics per prompt.

[aminaslo]

I see. That is unfortunate, but thank you for the explanation and the tool!