pycefrl

Identifying Python3 Code Level Using the CERFL Framework as Inspiration

What is this project about?

The goal of pycefrl is to create a tool capable of obtaining an evaluation inspired by the ''Common European Framework of Reference for Languages'' for code written in the Python programming language, version 3.

With this tool it is possible to analyze the level of GitHub repositories (and their developers) or code snippets in Python3.

How does it work?

To put it into operation you have to follow the steps below:

1. Edit the 'configuration.cfg' file with the level assignment of your choice. If you want to use the default ones (recommended), just go to step 2.

2. Install the required dependencies:

   pip install -r requirements.txt
   

3. Execute the file 'dict.py' to generate a level dictionary.

   python3 dict.py
   

4. Execute the main program 'pycerfl.py' in three different ways:

   • Analyze a directory.

     python3 pycerfl.py directory <name_path>
     

   • Analyze a GitHub repository.

     python3 pycerfl.py repo <name_urlclone>
     

   • Analyze a GitHub user.

     python3 pycerfl.py user <name_user>
     

5. After that, this program will generate two types of formats to view the results:

   • JSON: data.json
   • CSV: data.csv

Both of them including following information:

• Repository name
• File name
• Class of element
• Start Line
• End Line
• Displacement
• Level of element

6. If you want to visualize the results on a web page (legacy method):

   • Run the file 'main.js' to create the page 'index.html'. You will get one web page for each repository.

     node main.js
     

Interactive Web Interface (Streamlit)

A Streamlit application is included to easily run analyses and visualize results with interactive charts (Bubble Charts, Heatmaps, Treemaps) and system statistics.

To run the Streamlit app:

streamlit run app.py

Features:

• Select analysis mode: Directory, GitHub Repository, or GitHub User.
• Real-time execution logs and system stats (CPU/RAM).
• Interactive visualizations:
  • Bubble Chart: Category vs Level.
  • File Heatmap: File vs Level Count.
  • Element Treemap: Drill down into specific elements.
• Download reports in JSON and CSV formats.

Running Tests

The project includes a suite of unit tests to ensure the accuracy of level detection for various Python structures.

To run the tests:

python3 -m unittest discover tests

The tests cover:

• Simple and nested lists/loops (A1, A2).
• Control flow (If, While, Try/Except).
• Function and Class definitions (B1).
• Advanced structures like List Comprehensions and Generators (C1).