Skip to content

Client/Server core files #3

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 39 commits into
base: dev-team
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
39 commits
Select commit Hold shift + click to select a range
30ede39
added Client
Roeia99 Mar 24, 2023
08bf5a6
server docs
omarmoo5 Mar 24, 2023
e76ddd2
added testing model and testing dataset
Roeia99 Mar 24, 2023
e0cdb53
client/server fixed
omarmoo5 Mar 25, 2023
e7daa47
modified client
Roeia99 Mar 25, 2023
2b944c2
refactoring
omarmoo5 Mar 26, 2023
c5a2c45
nonIID dataset
Roeia99 Mar 27, 2023
43da7b6
modified load_datasets-->nonIID
Roeia99 Mar 28, 2023
573af29
added plotting using tensorboard
omarmoo5 Mar 28, 2023
ece22ce
Merge remote-tracking branch 'origin/dev/core' into mokh/tensorboard
omarmoo5 Mar 28, 2023
ae386f8
refactoring
omarmoo5 Mar 28, 2023
4ecb8b3
simulation
omarmoo5 Mar 28, 2023
9578034
added option for plotting train/test dataset eval metrics
omarmoo5 Mar 28, 2023
cfb8989
added config.ini
omarmoo5 Mar 29, 2023
66b69d3
Added new strategy
Roeia99 Mar 29, 2023
f4debaa
Merge branch 'mokh/configfile' into dev/core
omarmoo5 Mar 29, 2023
088b23e
server settings
omarmoo5 Mar 29, 2023
8fb6c83
server settings
omarmoo5 Mar 30, 2023
2f748ff
dataloader: prefinal
yehias21 Mar 30, 2023
31898bb
dataloader: prefinal
yehias21 Mar 30, 2023
cdb79c7
plotting metrics
omarmoo5 Mar 31, 2023
46f33f7
saving checkpoints
omarmoo5 Apr 1, 2023
e62848a
dataloader[Features to be added #5]
yehias21 Apr 1, 2023
1b94dda
Merge branch 'dev/core' of https://github.com/yehias21/FedRs into dev…
yehias21 Apr 1, 2023
e18b26a
model
yehias21 Apr 1, 2023
15d33a3
dataloader main
omarmoo5 Apr 1, 2023
69ba23b
movielens dataset adjustments
omarmoo5 Apr 1, 2023
48cf340
NeuMF model first trial !
omarmoo5 Apr 1, 2023
df68e25
code integration and some fixes
omarmoo5 Apr 2, 2023
596e451
code integration (parameters)
omarmoo5 Apr 2, 2023
bcb79d6
merged
omarmoo5 Apr 2, 2023
6f3965a
stateful clients
omarmoo5 Apr 2, 2023
baf1503
reduce the checkpoint size
omarmoo5 Apr 2, 2023
3edb1c5
send the updated item vectors
omarmoo5 Apr 3, 2023
f5d9efe
Added serverFedWAvg.py
Roeia99 Apr 3, 2023
14c10b9
send the updated item vectors in bytes
omarmoo5 Apr 15, 2023
44befd5
Merge remote-tracking branch 'origin/dev/core' into dev/core
omarmoo5 Apr 15, 2023
94ebbcd
send the updated item vectors in bytes
omarmoo5 Apr 15, 2023
ca4cf8d
remove the old files
omarmoo5 Apr 17, 2023
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Empty file removed data/raw/.gitkeep
Empty file.
170 changes: 170 additions & 0 deletions data/raw/ml-1m/README
Original file line number Diff line number Diff line change
@@ -0,0 +1,170 @@
SUMMARY
================================================================================

These files contain 1,000,209 anonymous ratings of approximately 3,900 movies
made by 6,040 MovieLens users who joined MovieLens in 2000.

USAGE LICENSE
================================================================================

Neither the University of Minnesota nor any of the researchers
involved can guarantee the correctness of the data, its suitability
for any particular purpose, or the validity of results based on the
use of the data set. The data set may be used for any research
purposes under the following conditions:

* The user may not state or imply any endorsement from the
University of Minnesota or the GroupLens Research Group.

* The user must acknowledge the use of the data set in
publications resulting from the use of the data set
(see below for citation information).

* The user may not redistribute the data without separate
permission.

* The user may not use this information for any commercial or
revenue-bearing purposes without first obtaining permission
from a faculty member of the GroupLens Research Project at the
University of Minnesota.

If you have any further questions or comments, please contact GroupLens
<[email protected]>.

CITATION
================================================================================

To acknowledge use of the dataset in publications, please cite the following
paper:

F. Maxwell Harper and Joseph A. Konstan. 2015. The MovieLens Datasets: History
and Context. ACM Transactions on Interactive Intelligent Systems (TiiS) 5, 4,
Article 19 (December 2015), 19 pages. DOI=http://dx.doi.org/10.1145/2827872


ACKNOWLEDGEMENTS
================================================================================

Thanks to Shyong Lam and Jon Herlocker for cleaning up and generating the data
set.

FURTHER INFORMATION ABOUT THE GROUPLENS RESEARCH PROJECT
================================================================================

The GroupLens Research Project is a research group in the Department of
Computer Science and Engineering at the University of Minnesota. Members of
the GroupLens Research Project are involved in many research projects related
to the fields of information filtering, collaborative filtering, and
recommender systems. The project is lead by professors John Riedl and Joseph
Konstan. The project began to explore automated collaborative filtering in
1992, but is most well known for its world wide trial of an automated
collaborative filtering system for Usenet news in 1996. Since then the project
has expanded its scope to research overall information filtering solutions,
integrating in content-based methods as well as improving current collaborative
filtering technology.

Further information on the GroupLens Research project, including research
publications, can be found at the following web site:

http://www.grouplens.org/

GroupLens Research currently operates a movie recommender based on
collaborative filtering:

http://www.movielens.org/

RATINGS FILE DESCRIPTION
================================================================================

All ratings are contained in the file "ratings.dat" and are in the
following format:

UserID::MovieID::Rating::Timestamp

- UserIDs range between 1 and 6040
- MovieIDs range between 1 and 3952
- Ratings are made on a 5-star scale (whole-star ratings only)
- Timestamp is represented in seconds since the epoch as returned by time(2)
- Each user has at least 20 ratings

USERS FILE DESCRIPTION
================================================================================

User information is in the file "users.dat" and is in the following
format:

UserID::Gender::Age::Occupation::Zip-code

All demographic information is provided voluntarily by the users and is
not checked for accuracy. Only users who have provided some demographic
information are included in this data set.

- Gender is denoted by a "M" for male and "F" for female
- Age is chosen from the following ranges:

* 1: "Under 18"
* 18: "18-24"
* 25: "25-34"
* 35: "35-44"
* 45: "45-49"
* 50: "50-55"
* 56: "56+"

- Occupation is chosen from the following choices:

* 0: "other" or not specified
* 1: "academic/educator"
* 2: "artist"
* 3: "clerical/admin"
* 4: "college/grad student"
* 5: "customer service"
* 6: "doctor/health care"
* 7: "executive/managerial"
* 8: "farmer"
* 9: "homemaker"
* 10: "K-12 student"
* 11: "lawyer"
* 12: "programmer"
* 13: "retired"
* 14: "sales/marketing"
* 15: "scientist"
* 16: "self-employed"
* 17: "technician/engineer"
* 18: "tradesman/craftsman"
* 19: "unemployed"
* 20: "writer"

MOVIES FILE DESCRIPTION
================================================================================

Movie information is in the file "movies.dat" and is in the following
format:

MovieID::Title::Genres

- Titles are identical to titles provided by the IMDB (including
year of release)
- Genres are pipe-separated and are selected from the following genres:

* Action
* Adventure
* Animation
* Children's
* Comedy
* Crime
* Documentary
* Drama
* Fantasy
* Film-Noir
* Horror
* Musical
* Mystery
* Romance
* Sci-Fi
* Thriller
* War
* Western

- Some MovieIDs do not correspond to a movie due to accidental duplicate
entries and/or test entries
- Movies are mostly entered by hand, so errors and inconsistencies may exist
Binary file added data/raw/ml-1m/ml-1m.zip
Binary file not shown.
Loading