Skip to content

aizej/Ai-for-4bit-inputs-from-scratch

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

5 Commits
 
 
 
 

Repository files navigation

Ai-for-4bit-inputs-from-scratch

flashback to 2021 when i made neural network for 4bit inputs from scratch

this projec wast test if i could use my knowlage about neural nets and training algorythms to make the simplest neural network and train it

the idea : make neural net that detects logic in examples and repeats it:

these are the training data: Screenshot 2023-02-20 121122

for 4 bit inputs we have total of 16 possible states curently we are training on dataset with size of 8

this is our structure of the network: images

firs we will make random weights and bias: Screenshot 2023-02-20 123530

then we train our network by adjusting our weights and bias by smaller and smaller amounts based on number of epochs and our learning rate: Screenshot 2023-02-20 130025 Screenshot 2023-02-20 130126 Screenshot 2023-02-20 1319252

and then we chose weights and biases that are better by good gueseses and error: Screenshot 2023-02-20 132143 Screenshot 2023-02-20 132304

at the end we graph it and do lil demo for testing: Screenshot 2023-02-20 134625

About

flashback to 2021 when i made neural network for 4bit inputs from scratch

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors

Languages