Commit 5dbf127

authored and

committed

add java_tokenizer.py (#8)

1 parent 7ca2951 commit 5dbf127Copy full SHA for 5dbf127

4 files changed

+528

-0

lines changed

tokenizer/java
- README.md
- expected_output
  - output.json
- input_with_error.java
- java_tokenizer.py

4 files changed

+528

-0

lines changed

`‎tokenizer/java/README.md`

+9

-Original file line number
+Diff line change
@@ @@ -0,0 +1,9 @@ @@
 +Installation Instruction:-
++
 +pip3 install javac_parser
++
 +Usage:-
++
 +To produce output in stdout consisting of tokens of the input file, just run-
++
 +python3 java_tokenizer.py path/to/inputfile

Comments

(0)