Skip to content

Commit 71fcc15

Browse files
committed
Merge branch 'master' of github.com:tattle-made/website
2 parents a22e80e + c7eaa32 commit 71fcc15

File tree

4 files changed

+105
-0
lines changed

4 files changed

+105
-0
lines changed
82.5 KB
Loading
78.4 KB
Loading

src/pages/report/2024-report.mdx

Lines changed: 104 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,104 @@
1+
import DefaultLayoutNarrow from "@/components/default-layout-narrow"
2+
3+
export default function Layout({ children }) {
4+
return <DefaultLayoutNarrow>{children}</DefaultLayoutNarrow>
5+
}
6+
7+
# Annual Report
8+
9+
### (March 2024 - Feb 2025)
10+
11+
![Annual Report Cover](../../images/annual_report_2024-%20dau.jpg)
12+
13+
Six. As children, when we learnt to count, six was when you knotted up the old sticks, and started a new bundle. That is a good metaphor to describe our sixth year.
14+
15+
Our sixth year was "[the biggest election year in human history](https://www.undp.org/super-year-elections)". Sixty plus countries, and over three billion people across the world, voted. Generative AI gate crashed, in an already fragile information ecosystem.;
16+
17+
We started our year with our heads and knees deep in the tech behind the Deepfakes Analysis Unit. We had two months to set up the WhatsApp tipline and dashboard for collective analysis of AI generated content. It was the perfect opportunity to leverage and mark five years of work. It was a new challenge but we knew we had the building blocks in place to get it done.
18+
19+
Till the summer, until after the elections were over, we were in alert mode, making sure that there was no down time during the election season. Year six was marked by three big projects:
20+
21+
1. Deepfakes Analysis Unit:
22+
While DAU was launched in year five, the meat of the work was in year six . Since April of 2024 we have added more languages, improved the reliability of message delivery and improved the machine learning systems that cluster similar media items. The DAU WhatsApp chatbot has been used by over 10,000 individuals, including fact checkers, across the world. DAU has been [featured by The New York Times](https://www.nytimes.com/2024/06/01/world/asia/india-election-deepfakes.html), and received the award for the “[Most Innovative Collaboration](https://www.poynter.org/fact-checking/2024/fact-checkers-from-turkey-india-and-georgia-win-globalfact-11-awards/)” at Global Fact 11.
23+
24+
2. [Building AI Safety Benchmarks with MLCommons](https://tattle.co.in/products/ml-commons-safety-benchmark/)
25+
As a pilot project selected by [MLCommons](https://mlcommons.org/), we tested the expert led participatory methodology that we piloted with Uli, to create contextually relevant safety benchmarks in Hindi.
26+
27+
3. Uli:
28+
We continued to grow the Uli dataset through crowdsourcing sessions. We also added features to the plugin so that people can contribute words to the public collection of slur words directly through the plugin. Users can also now view the meaning of the slurs that show up on their websites by hovering on the words.
29+
30+
The Uli dataset itself is being used by platforms and researchers to better understand and remove hateful content.
31+
32+
33+
## Community Building:
34+
35+
It was also our biggest year in terms of community building around our work, and indirectly towards open source projects:
36+
37+
- We put together the second edition of [MisinfoCon India](https://www.misinfoconindia.com/ "MisinfoCon India 2025"), with support from Hacks/Hackers and Thoughtworks . The two day cross-disciplinary gathering touched on themes of AI and misinformation, financial scams and the future of decentralized platforms.
38+
- Tattle partnered with University of Amsterdam and Aapti institute to put together a two day workshop on Mapping Data Work.
39+
- We participated in Samagra Foundation's Code4GovtTech program with three projects: Feluda, Uli and the a UX project around the Deepfakes Analysis Unit. We mentored four contributors through three months. All the contributions were notable and some of the contributors continued to work with us after the three months of the program.
40+
- We mentored budding community managers through GitHub's community based volunteering program that aims to increase contributions to open source projects that further SDGs.
41+
- We were generously hosted at TinkerHub for a week. We spoke to the students there about the need to do socially grounded work that starts from the needs on ground, rather than the tech at hand.
42+
- We joined the advisory group for the 2025 UNFPA Global Symposium on technology-facilitated gender-based violence (TFGBV)
43+
- We created an online module as a Knowledge Partner for the School of Campaigners, a joint initiative of Access Polity (NETRI) & Apolitical Foundation, focused on OGBV and its impact on women politicians.
44+
45+
46+
47+
## Research
48+
49+
- We published a report to evaluate the performance of text-in text-out Large Language Models (LLMs) to [understand and generate Indic languages.](https://arxiv.org/abs/2501.13912)
50+
- We wrote [a report](https://drive.google.com/file/d/1OKpZ7qqT6hjbzaeUC7UnBF1oCTn7c70z/view "Tattle-MLCommons_Hindi-AISafety-Benchmark-Datasets_FINAL.pdf") for MLCommons on creating [safety benchmarks](https://mlcommons.org/ailuminate/methodology/) on sex related crimes and hate in Hindi, with expert insights.&#x20;
51+
- The [Uli dataset paper](https://aclanthology.org/2024.woah-1.16.pdf) received the Outstanding Paper Award at the Workshop on Online Abuse and Harms, held at the NAACL 2024.
52+
53+
54+
## Talks:
55+
56+
The Tattle team had a busy travel schedule last year. Following is the list of notable talks:
57+
58+
- We presented our paper on Indic Language Performance in LLMs at the Agency Fund's AI For Global Development Event.
59+
- We spoke at three events at RightsCon, 2025 in Taipei on AI and misinformation, AI enabled gendered abuse, and our work with the Deepfakes Analysis Unit.
60+
- We spoke about the digital gender divide at the Asia-Pacific Ministerial Conference on the Beijing30 review, organized by CEVAW and the Australia eSafety Commission.
61+
- We spoke at the Association of Internet Researcher's symposium in Hyderabad on the theme of building a more just and fair internet through design, code, and content.
62+
63+
64+
## Revenue
65+
66+
- Revenue from technical consulting: INR 11,366,200/ USD 132,985
67+
- Grant from Nummun Fund: INR 826,600 / USD 10,000
68+
- Events: INR 30,474
69+
70+
\
71+
\
72+
Conversion rate used: $1 = INR 85.47
73+
74+
## Expenditures
75+
76+
The primary cost drivers for the year were:
77+
78+
- Full-time Staff for the Project.
79+
- Infrastructure costs for running our projects
80+
- Travel costs associated with events and conferences
81+
82+
![expenditures-2024-2025.png](../../images/expenditures-2024-2025-chart.png)
83+
84+
### Contributors/Collaborators:
85+
86+
### Project Specific:
87+
- MisinfoCon: Saurav Verma
88+
- Uli: Srravya Chandramowli
89+
- DAU: Yogesh GiriKumar
90+
- MLCommons: Mamta Singh, Mansi Gupta, Saumya Gupta, Saurav Verma, Srravya Chandramowli
91+
92+
93+
### Organization Wide:
94+
- Aatman Vaidya: Fullstack developer
95+
- Aurora: Accessibility and security engineer
96+
- Kaustubha Kalidindi: Uli Program Manager and Legal Counsel
97+
- Maanas Bhardwaj: Fullstack developer
98+
- Manisha Kumari: Junior Fullstack developer
99+
- Yohan Mathew : Advisor
100+
- Yash Budhwar: Operations, comms, HR
101+
- Komal Shivdasani: Accounts, HR
102+
- Neha Tuheen: Digital Marketing
103+
104+

src/pages/report/index.jsx

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -5,6 +5,7 @@ import { Link } from "gatsby" // Import Gatsby's Link component
55

66
export default function Layout({ children }) {
77
const reports = [
8+
{ year: "2024", link: "/report/2024-report" },
89
{ year: "2022", link: "/report/2022-report" },
910
{ year: "2021", link: "/report/2021-report" },
1011
{ year: "2020", link: "/report/2020-report" },

0 commit comments

Comments
 (0)