Skip to content
GitLab
Projects
Groups
Snippets
Help
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Sign in / Register
Toggle navigation
P
Programs_For_Annotation
Project overview
Project overview
Details
Activity
Releases
Repository
Repository
Files
Commits
Branches
Tags
Contributors
Graph
Compare
Issues
0
Issues
0
List
Boards
Labels
Service Desk
Milestones
Merge Requests
0
Merge Requests
0
CI / CD
CI / CD
Pipelines
Jobs
Schedules
Operations
Operations
Metrics
Environments
Packages & Registries
Packages & Registries
Package Registry
Analytics
Analytics
CI / CD
Repository
Value Stream
Wiki
Wiki
Snippets
Snippets
Members
Members
Collapse sidebar
Close sidebar
Activity
Graph
Create a new issue
Jobs
Commits
Issue Boards
Open sidebar
pruthwik mishra
Programs_For_Annotation
Commits
e7a17bb1
Commit
e7a17bb1
authored
Aug 16, 2022
by
pruthwik mishra
Browse files
Options
Browse Files
Download
Email Patches
Plain Diff
Update tokenizer_for_indian_languages_on_files.py
parent
6e4b830f
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
1 addition
and
1 deletion
+1
-1
tokenizer_for_indian_languages_on_files.py
tokenizer_for_indian_languages_on_files.py
+1
-1
No files found.
tokenizer_for_indian_languages_on_files.py
View file @
e7a17bb1
...
...
@@ -137,7 +137,7 @@ def main():
os
.
makedirs
(
args
.
out
)
if
args
.
lang
in
[
'hi'
,
'or'
,
'mn'
,
'as'
,
'bn'
,
'pa'
]:
lang
=
0
elif
args
.
lang
==
'ur'
:
elif
args
.
lang
in
[
'ur'
,
'ks'
]
:
lang
=
1
elif
args
.
lang
in
[
'en'
,
'gu'
,
'mr'
,
'ml'
,
'kn'
,
'te'
,
'ta'
]:
lang
=
2
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment