Skip to content

A project for natHACKS 2023 focused on brain-to-text and speech-to-text capabilities.

Notifications You must be signed in to change notification settings

Jewels2001/CogLog

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

64 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

A brain-to-data platform by .

For natHACKS 2023 focused on brain-to-text and speech-to-text capabilities.

/// IntroHow to UseFutureContributorsLinksResources

Intro

Brain-Computer Interface (BCI) equipment allows people to connect with their environment and other people with greater awareness and capability. CogLog has produced a SAAS called Cerecode that leverages BCI technology to convert brain wave readings into spoken speech. This gives people who have limited or decreasing speech capabilities a way to communicate more clearly with those around them. More specifically, Cerecode utilizes models from the open-source dataset associated with "A high-performace speech neruprosthesis" which focuses on decoding phonemes from intracortical microelectrode arrays.

Usage

Client-Side:

npm install

npm run dev

Decoder Model:

Important

We used a 16 vCPU + 128GB RAM VM to host the model. 64GB was not enough.

Gateway Service:

go run server.go

Roadmap for Future

We can improve upon our SAAS by providing a fully functioning platform, and implementing tools such as wearables and mobile apps. This could also lead to the ability to make a natural recording of one's thoughts, such as live note-taking (during lectues or meetings) or an idea journal. We could also personalize this usecase, by providing support for multiple voices and enable real time decoding of brain data. Further, we could improve upon our decoding performace, possibly writing our own BCI decoder model fromm scratch with a larger and more robust dataset.

Contributors

  • Ali Amusat: Neuroscience Specialist, Graphic and UI/UX Designer
  • Rozella Ricci Dagta: Graphic and UI/UX Designer, Full Stack
  • Alex Hughes: Business Strategist, Frontend
  • Dustin Ward: Backend, Full Stack
  • Julie Wojtiw-Quo: ML Specialist, Full Stack

Project Links

Resources

About

A project for natHACKS 2023 focused on brain-to-text and speech-to-text capabilities.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Contributors 4

  •  
  •  
  •  
  •